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CHAPTER  I 


INTRODUCTION 

The  role  of  diet  in  the  prevention  of  chronic  disease  has  been  well  established 
over  the  past  10  years  (1,2).  However,  many  of  the  Healthy  People  2000  objectives 
related  to  nutrition  are  not  being  achieved  (3).  Based  on  the  most  recent  data,  the 
percentage  of  overweight  Americans  is  increasing,  fewer  overweight  individuals  are 
using  sound  weight  loss  practices,  and  the  number  of  individuals  consuming  a  nutrient- 
rich  diet  is  decreasing  (3,4).  The  American  Dietetic  Association  (ADA)  recently 
commented  on  the  changes  to  the  Healthy  People  2000  nutrition  objectives  to  be  achieved 
by  the  year  2010  (5).  These  changes  include  additional  emphasis  on  the  number  of 
Americans  eating  adequate  fruits,  vegetables,  grains  and  calcium-rich  foods,  consuming 
less  than  30%  of  calories  from  fat  and  maintaining  their  desirable  body  weight.  Based  on 
current  data  and  ADA's  proposal  to  strengthen  the  Healthy  People  2000  objectives,  the 
need  for  more  innovative  and  effective  nutrition  education  is  clear. 

ADA  and  the  Society  for  Nutrition  Education  (SNE)  provide  frameworks  for 
educating  the  public  on  diet  and  nutrition  (6,7).  Both  organizations  acknowledge  the 
need  for  resource  development  and  creative  new  programs  to  reach  and  influence 
consumers.  To  be  successful,  nutrition  education  programs  should  go  beyond  merely 
providing  knowledge  passively,  hoping  knowledge  alone  will  change  behavior.  Rather, 
nutrition  education  must  bridge  the  gap  between  knowledge  and  action  with  behaviorally- 
focused  programs  that  teach  skills  consumers  can  use  to  change  their  diets.  The  programs 
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must  also  meet  a  defined  "need"  within  the  target  population,  be  personalized,  and 
involve  active  learner  participation. 

Computers  offer  a  viable  means  for  educating  the  public  about  diet  and  nutrition. 
When  computer  programs  were  used  to  teach  adults  about  nutrition,  they  were  foimd  to 
be  effective  and  well  received  (8-13).  Despite  these  findings,  computer  use  in  nutrition 
education  remains  limited  (8,14,15).  One  reason  computers  are  limited  in  nutrition  may 
be  a  lack  of  acceptance  and  understanding  of  technology  by  nutrition  personnel  (12). 
Another  reason  computer  use  may  be  limited  is  software  and  hardware  incompatibilities 
and  a  shortage  of  people  skilled  in  developing  quality  software,  resulting  in  low-quality 
products  in  the  marketplace  (16).  According  to  Kolasa  (14)  and  Byrd-Bredbenner  and 
Bauer  (8)  use  of  computers  is  limited  in  nutrition  education  because  of  a  dearth  of  well- 
designed  and  stand-alone  software  programs  with  the  adult  learner  in  mind.  Although 
computers  have  been  used  extensively  for  nutrient  calculations,  only  a  small  number  of 
computer  programs  have  been  used  for  nutrition  education  in  schools,  clinics,  extension 
programs  and  homes,  and  even  fewer  programs  have  been  developed  specifically  for 
adults  (17). 

Computers  offer  many  advantages  that  appeal  to  an  adult's  learning  preferences 
(18-20).  Adults  have  unique  characteristics  and  bring  life  experiences  to  the  learning 
enviroiunent,  making' their  perspective  on  learning  different  from  that  of  children.  Adults 
can  be  described  as  self-directed,  problem-solving,  skill-seeking  and  internally  motivated 
learners  (21).  Correspondingly,  computers  offer  privacy,  a  high  degree  of  learner  control, 
24-hour  availability,  and  self-paced  and  individualized  learning.  Computer  programs  also 
give  consistent,  unbiased  messages,  and  are  free  from  fatigue.  The  programs  can  include 


3 

practice  and  feedback  features,  which  appeal  to  the  adults'  need  for  active  participation. 
Additionally,  computer  programs  can  appeal  to  multiple  learning  styles  with  the  inclusion 
of  sound,  pictures,  and  animation  (17,22). 

A  plethora  of  dietary  analysis  programs  exist,  although  most  are  not  designed  as 
instructional  programs.  Rather,  these  programs  assess  an  individual’s  diet  and  make  one 
aware  of  his/her  diet’s  strengths  and  weaknesses.  Most  do  not  teach  learners  the  skills 
necessary  to  enable  them  to  modify  their  diets  or  to  change  their  dietary  behaviors. 

To  ensure  the  development  of  effective  and  innovative  nutrition  education 
computer  programs,  systematic  models  of  instructional  design  should  be  utilized.  The 
Dick  and  Carey  (23)  model  of  instructional  design  employs  a  systematic,  step-by-step 
approach  that  novice  programmers  and  non-programmers  (i.e.  nutrition  educators)  can 
use  to  design  effective  instruction.  This  model  has  been  in  use  since  1968  (24)  and  is 
based  on  more  than  25  years  of  research  on  the  learning  process  and  instructional  design. 
Its  initial  focus  is  on  what  the  learner  must  know  or  be  able  to  do  upon  completion  of  the 
lesson.  Because  it  is  a  systems  model,  it  offers  congruency  from  objectives  through 
evaluation.  Data  are  collected  to  determine  what  instructional  segment  is  not  working 
and  through  formative  evaluation,  the  instruction  is  revised  imtil  it  does  work. 

Effective  nutrition  education  computer  programs  should  also  include 
characteristics  of  effective  computer-aided  instruction  (25),  make  use  of  sound  screen 
design  principles  (18,26,27),  and  include  the  nine  events  of  instruction  which  define  the 
learning  process  (28).  Some  of  the  characteristics  of  an  effective  nutrition  education 
computer  program  include  behaviorally-based  objectives  that  teach  the  learner  a  skill. 

The  language,  examples,  feedback  and  content  should  match  the  characteristics  of  the 
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target  population,  be  relevant  to  them  and  should  be  congruent  with  the  objectives  of  the 
program.  The  program  should  also  be  interactive,  individualized,  and  maintain  the 
interest  of  the  learner.  Prior  to  implementation,  it  should  be  thoroughly  evaluated  by  the 
user  and  developer. 

Effective  nutrition  computer  programs  should  also  contain  soimd  screen  design 
principles  such  as  simplicity,  consistency,  and  clarity  (26).  The  information  presented 
should  be  simple  and  straightforward.  Also,  the  look  across  screens  should  be  consistent 
within  a  single  program  or  series  of  programs  (18).  This  allows  the  learner  to  concentrate 
on  the  lesson  instead  of  learning  how  to  use  the  program  (29,30).  The  designer  should 
use  concrete  language  and  terminology  that  is  easy  to  understand  (27). 

Effective  nutrition  education  programs  should  also  include  the  nine  events  of 
instruction  which  define  the  learning  process  (28).  The  program  should  gain  the  learner’s 
attention  and  inform  them  of  the  objectives.  It  should  stimulate  recall  of  prior  learning, 
contain  distinctive  stimuli  to  gain  the  learner’s  attention,  and  guide  learning.  The 
program  should  require  the  learner  to  participate  in  the  lesson  while  the  program  provides 
informative  feedback.  The  program  should  assess  a  learner’s  progress  within  the  program 
and  offer  ways  to  help  the  learner  retain  and  transfer  the  learning. 

Based  on  the  current  state  of  technology,  an  innovative  nutrition  education 
strategy  that  will  enable  adults  to  make  dietary  behavior  changes  consistent  with  the 
Healthy  People  2010  nutrition  objectives  (5)  is  needed.  One  option  for  meeting  this  need 
is  to  merge  effective  design  strategies  in  computer-based  instruction  with  effective 
nutrition  education  strategies  to  create  a  well-designed  computer  program. 
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Statement  of  Purpose: 

It  is  the  purpose  of  this  study  to  design,  develop,  and  formatively  evaluate  a 
computer-based  multimedia  nutrition  education  program  for  adults.  The  design, 
development,  and  formative  evaluation  is  based  on  the  well  accepted  Dick  and  Carey  (23) 
model  of  systematic  instructional  design.  The  program  is  designed  to  teach  the  skill  of 
analyzing  and  then  modifying  one’s  diet  based  on  serving  size  recogmtion  and  principles 
of  the  Food  Guide  Pyramid  (32)  and  was  thus  named  “Put  Nutrition  Into  Practice.” 
Offered  as  an  innovative  nutrition  education  strategy,  this  program  will  enable  adults  to 
make  dietary  behavior  changes  in  order  to  meet  Healthy  People  2010  objectives.  This 
study  is  unique  in  that  it  merges  proven  instructional  design  strategies  with  proven 
nutrition  education  strategies  to  create  a  well-designed  computer  program. 


CHAPTER  II 


REVIEW  OF  LITERATURE 


The  role  of  diet  in  health  promotion  and  disease  prevention  has  been  well 
described  during  the  past  decade  (1,2).  However,  many  national  nutrition  objectives  are 
not  being  achieved  (3).  The  American  Dietetic  Association  (ADA)  and  the  Society  for 
Nutrition  Education  (SNE)  provide  frameworks  for  educating  the  public  on  diet  and 
nutrition  (6,7).  Both  organizations  acknowledge  the  need  for  resource  development  and 
creative  new  programs  to  reach  and  influence  consumers.  To  be  successful  nutrition 
education  should  go  beyond  merely  providing  knowledge  passively,  hoping  knowledge 
alone  will  change  behavior.  Rather,  nutrition  education  must  bridge  the  gap  between 
knowledge  and  action  with  behaviorally-focused  programs  that  teach  skills  consumers 
can  use  to  change  their  diets.  The  programs  must  also  meet  a  defined  “need”  within  the 
target  population.  Additionally,  they  should  motivate  learners,  be  personalized,  and 
involve  active  learning.  With  the  increase  in  the  number  of  personal  home  computers  and 
individuals  having  access  to  public  computers  in  libraries,  schools,  the  work  place,  and 
health  and  wellness  centers,  computers  offer  a  viable  means  for  educating  the  public 
about  nutrition. 

Educational  Advantages  of  Computers 

The  computer  offers  many  educational  advantages  (17,22).  It  is  available  when 
the  consumer  wants  it  and  needs  it.  Adults  learn  best  when  they  have  a  “need”  for  the 
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education.  A  computer  program  does  not  tire  or  fatigue  and  gives  consistent  messages  to 
all  consumers.  It  can  offer  self-paced  and  individualized  learning.  It  allows  for  privacy 
and  is  imbiased.  Through  drill  and  practice  and  tutorials,  it  allows  for  practice  and 
immediate  feedback.  The  information  can  be  updated  regularly.  Lastly,  multimedia 
programs  can  appeal  to  many  different  learning  styles  with  the  inclusion  of  sound, 
pictures  and  animation. 

Computer  Use  in  Nutrition  Education 

In  1984,  an  entire  issue  of  the  Journal  of  Nutrition  Education  was  dedicated  to  the 
use  of  computers  in  nutrition  education  (32).  In  this  issue,  nutrition  educators  were 
encouraged  to  develop  and  adopt  this  rapidly  expanding  technology.  However,  in  a  1996 
special  theme  issue  of  the  Journal  of  Nutrition  Education  on  multimedia  and  computers 
in  nutrition  education,  Kolasa  (14)  noted  that,  except  for  computers  being  used  for 
nutrient  calculations,  only  a  small  number  of  computers  are  being  used  in  schools,  clinics, 
extension  programs  and  homes  for  the  purpose  of  nutrition  education. 

Despite  their  limited  use,  when  computers  have  been  used  in  college  nutrition 
classes,  to  teach  food  service  personnel,  and  in  the  Special  Supplemental  Food  Program 
for  Women,  Infants,  and  Children  (WIC),  they  have  been  shown  to  increase  knowledge 
(8-13).  Some  computer  programs  have  been  developed  and  tested  in  college  level 
nutrition  classes.  Beerman  (9)  compared  grades  of  students  who  were  taught  with 
multimedia  versus  traditional,  lecture-type  education  using  an  overhead  projector.  The 
computer  was  used  to  enhance  the  lesson,  rather  than  as  a  replacement  for  teaching. 
Beerman  (9)  foimd  that  students  taught  with  an  overhead  projector  and  lecture  had 
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significantly  lower  mean  test  scores  (77.05  ±  17.63,  semester  1  and  76.6  ±  13.8,  semester 
2)  than  students  taught  with  multimedia  (81.6  ±  10.9,  semester  1  and  84.2  ±10.81, 
semester  2)  (p<  0.05).  She  also  reported  that  fewer  students  taught  with  multimedia 
failed  or  received  a  below-average  grade. 

Computer  programs  were  also  shown  to  be  effective  when  they  replaced  part  of 
the  instruction  in  an  introductory  college-level  nutrition  course  (8).  Entire  classes  were 
randomly  assigned  to  either  experimental  or  control  groups.  The  experimental  groups 
completed  seven  computer  modules  on  various  nutrition  related  topics  and  were 
dismissed  firom  one  class  period  per  module  to  account  for  time  spent  completing  the 
modules  while  students  in  the  control  group  attended  only  lectures.  Students  in  the 
experimental  group  scored  higher  on  all  seven  modules  compared  to  controls.  Students  in 
the  experimental  group  had  higher  mean  tests  scores  than  controls  in  the  carbohydrate 
module  (max.  score  =  8,  mean  scores  7.2  ±  0.2  vs.  5.57  ±  0  .2,  p<.0001)  and  lipids 
module  (max.  score  =  7,  mean  scores  5.53  ±  0.17  vs.  4.03  ±  0.17,  p<.0001).  Likewise, 
the  experimental  group  had  higher  mean  tests  scores  in  the  protein  module  (max.  score  = 
8,  mean  scores  5.43  ±  0.21  vs.  3.76  ±  0.2,  p<.0001),  digestion  module  (max.  score  =  7, 
mean  scores  4.91  +  0.19  vs.  2.48  ±  0.19,  p<.0001)  and  energy  balance  module  (max. 
score  =  7,  mean  scores  5.1 1  ±0.16  vs.  3.69  ±  0.16,  p<.0001).  The  students  in  the 
experimental  group  also  had  higher  mean  test  scores  than  the  control  group  in  the  vitamin 
module  (max.  score  =  3,  mean  scores  1.72  ±0.11  vs.  1.37  ±  0.11,  p<  .05)  and  in  the 
mineral  module  (max.  score  =  10,  mean  scores  7.65  ±  0.21  vs.  5.95  ±  0.21,  p<.05). 
Possible  explanations  for  higher  tests  scores  among  the  experimental  group  include  the 
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computer’s  ability  to  individualize  learning  and  promote  more  active  learning  than 
lectures.  Another  reason  may  be  that  students  using  the  computerized  lesson  took  more 
time  reviewing  the  material  than  those  who  attended  only  lectures.  The  experimental 
group  spent  an  average  of  2.5  hours  on  a  computer  lesson  that  would  have  been  covered 
in  1.25  hours  in  a  lecture.  In  addition  to  college  courses,  computers  have  also  been 
shown  to  be  effective  in  food  service  education. 

Computers  have  been  as  successful  as  lecture  type  training  to  teach  hospital  food 
service  employees  about  sanitation  (13).  Eighty-seven  employees  were  randomly 
assigned  to  one  of  three  groups;  a  control  group  (no  training),  a  computer-aided 
instruction  group  (CAI),  or  a  lecture  method  instruction  group  (LMI).  On  the  post-test, 
the  control  group  scored  significantly  lower  (max.  score  =  73,  mean  score  =  47.94)  than 
the  CAI  group  (max.  score  =  73,  mean  score  =  55.17)  and  the  LMI  group  (max.  score  = 
73,  mean  score  =  49.80)  (p  <  .05).  The  CAI  group  obtained  higher  mean  score  than  the 
LMI  group,  although  scores  were  not  significantly  different.  The  authors  concluded  that 
CAI  is  as  effective  as  LMI  in  training  food  service  employees. 

A  computerized  program  was  developed  and  tested  on  adult  clients  enrolled  in 
Maine’s  WIC  clinics  (12).  International  Business  Machines  (IBM)  worked  with  WIC 
program  managers  to  develop  an  interactive  multimedia  nutrition  education  kiosk 
program.  Pre-  and  post-test  knowledge  surveys  were  completed  by  728  participants. 
Responses  to  44  of  the  66  survey  questions  related  to  breastfeeding,  food  shopping, 
smoking  and  healthy  habits  improved  after  participants  reviewed  the  program’s  modules. 
Responses  to  the  remaining  22  questions  did  not  improve  from  pre-  to  post-test  measures. 
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The  authors  concluded  that  viewing  any  module  resulted  in  some  positive  changes  in 
clients’  knowledge,  attitudes  or  behavioral  intentions  and  that  interactive  multimedia 
software  programs  are  a  viable  means  for  delivering  nutrition  education  to  low-income, 
high-risk  populations. 

Other  nutrition  education  computer  programs  have  been  developed  for  an  adult 
population  although  development  and  evaluation  of  these  have  not  been  reported  in  the 
literature  (17).  Two  such  programs  include  Health  Talk,  designed  for  low-literacy 
populations  and  Stamp  Smart,  designed  for  an  inner-city  food  stamp  office.  Health  Talk 
collects  dietary  information  from  the  user  and  creates  a  personalized  knowledge-  and 
behavior-change  program  using  algorithms  for  goal  setting.  Stamp  Smart  is  an  effort  to 
promote  low-fat,  low-cholesterol,  high-vegetable  diets  to  women  who  receive  food 
stamps.  Although  many  nutrient  analysis  software  programs  are  in  the  marketplace  and 
have  been  used  for  many  years  (14,17),  most  are  not  designed  as  instructional  programs. 
Rather,  these  programs  are  designed  to  assess  the  nutrient  composition  of  an  individual’s 
diet  and  increase  knowledge  regarding  dietary  strengths  and  weaknesses. 

Acceptability  of  Computers  in  Nutrition  Education 

The  literature  reveals  that  not  only  is  computerized  instruction  effective,  but  that 
adults  are  receptive  to  using  it.  In  some  cases,  adults  prefer  computer  instruction  to  the 
more  passive,  traditional,  lecture  method  of  instruction.  For  example,  in  Maine’s  WIC 
clinics,  98%  of  clients  said  they  would  use  a  computer-based  kiosk  again  (12).  Ninety- 
three  percent  of  interviewed  clients  reported  positive  feelings  about  using  multimedia  to 
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leam  and  54%  preferred  using  the  kiosk  to  interacting  with  a  person.  They  liked  the  non- 
judgmental  aspects  of  the  computer  and  the  privacy  it  offered  for  learning. 

Even  senior  citizens  who  had  little  computer  knowledge  or  experience  were 
receptive  to  a  computerized  self-interviewing  program  (33).  Senior  citizens  65  years  and 
older  were  divided  into  two  groups,  one  group  received  nutrition  education  with  DINE  (a 
computerized  self-interviewing  program)  and  one  group  received  nutrition  education 
without  DINE.  The  computer  interviewed  group  was  as  satisfied  with  the  overall 
instruction  (mean  score  =  8.26  on  a  scale  of  0  “very  dissatisfied”  to  10  “very  satisfied”) 
as  those  interviewed  without  the  computer  (mean  =  8.42).  Eighty  percent  of  individuals  in 
the  computer  group  said  that  it  was  not  difficult  to  use  the  computer  program  and  it  was 
somewhat  to  very  enjoyable. 

School  food  service  personnel  trained  via  computer-assisted  instruction  (CAI)  on 
how  to  use  computers  also  showed  favorable  attitudes  (11).  After  the  training  session, 
83%  no  longer  feared  the  computer  and  97%  liked  the  computer  as  a  training  technique. 
Additionally,  when  food  service  personnel  were  trained  with  computers  on  sanitation, 
their  attitudes  toward  CAI  and  toward  sanitation  training  improved  (pre-training  attitude 
scores  mean  =  36.24  and  post-training  attitude  scores  mean  =  42.89,  max.  score  =  50) 
(13).  Studies  also  suggest  that  college  students  have  favorable  attitudes  toward 
computerized  instruction.  One  study  showed  that  75%  of  students  believed  multimedia 
facilitated  their  learning  (9).  Another  study  revealed  college  students’  enjoyed  using 
computers  (mean  =  3.42  ±  0.08,  scale  range  1-5),  they  believed  the  computer  helped  them 
leam  (mean  =  3.51  ±  0.08,  scale  range  1-5),  and  they  wanted  to  use  it  again  (8). 
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Reasons  Computer  Programs  Are  Limited  in  Nutrition  Education 

While  adults  and  seniors  citizens  in  the  above  studies  were  receptive  to  using 
computers  for  nutrition  education  and  the  computer  proved  to  be  effective  in  improving 
knowledge,  its  use  in  nutrition  education  is  limited  for  a  variety  of  reasons  (8,14,15). 

One  reason  cited  is  lack  of  staff  acceptance.  When  a  kiosk  was  placed  in  one  Maine  WIC 
clinic,  the  staff  reported  that  the  computer  made  their  clinic  less  efficient  and  they  did  not 
agree  with  the  modules  used  in  the  program  (12).  Another  reason  computers  may  be 
limited  in  education  may  be  software  and  hardware  incompatibilities  (16).  Still,  another 
factor  that  inhibits  computer-based  education  is  a  shortage  of  people  skilled  in  developing 
quality  courseware,  which  has  resulted  in  much  low  quality  software  in  the  market  (16). 

Nutrition  educators  seem  to  agree  with  instructional  designers  and  state  that  one 
reason  computers  are  limited  in  nutrition  education  is  a  dearth  of  well-designed  and 
stand-alone  nutrition  education  software  programs  developed  with  the  adult  learner  in 
mind  (8,14).  A  review  of  software  programs  on  the  market  showed  that  many  have  very 
broad  target  audiences  ranging  from  middle  school  learners  to  adults  (17).  Adults  have 
rmique  characteristics  and  bring  life  experiences  to  the  learning  environment,  making 
their  perspective  on  learning  different  from  that  of  the  traditional  youthful  student  (21). 
Adult  Learning  Characteristics 

Malcolm  Knowles,  often  called  the  father  of  adult  learning,  was  the  first  to 
distinguish  the  characteristics  of  adults  that  make  them  different  from  children  in  regards 
to  how  they  learn.  Knowles  (21)  identified  five  characteristics  of  adult  learners.  Adults 
have  a  deep  psychological  need  to  be  self-directing  in  learning  situations.  They  also  have 
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life  experiences  that  provide  for  a  rich  resource  for  learning.  Also,  adults’  readiness  to 
learn  is  linked  to  what  they  need  to  know  in  order  to  fulfill  their  roles  and  responsibilities 
as  adults  in  society.  Their  orientation  to  learning  is  problem-centered  rather  than  subject- 
centered.  Lastly,  adults  are  more  internally  motivated  to  learn  than  they  are  by  external 
rewards. 

These  characteristics  of  adult  learners  provide  specific  implications  for  the 
teaching  and  learning  process  (20).  For  example,  adults  are  self-directing  and  prefer  a 
more  active  role  in  the  learning  process.  They  want  to  be  involved  in  some  way  in 
planning  and  directing  their  learning  activities.  They  bring  with  them  a  wide  variety  of 
prior  education  and  life  experiences  to  be  built  upon  in  the  learning  environment.  They 
are  more  self-reliant  and  independent  than  children  and  they  draw  upon  their  own 
knowledge  and  life  experiences  to  solve  problems  and  learn  new  information.  Adults 
focus  their  attention  on  real-world  situations  and  deal  with  problems  they  encounter  in 
life.  They  can  be  described  as  solution-driven  and  skill-seeking,  meaning  they  actively 
seek  out  solutions  to  solve  their  problems.  Adults,  unlike  children,  also  need  to  know 
why  they  are  learning  something,  before  they  will  invest  time  in  learning.  Also,  they 
would  rather  learn  by  doing  than  listening.  Adults  are  both  internally  motivated  (by  self 
esteem,  overall  quality  of  life,  confidence,  and  job  satisfaction)  and  to  a  lesser  extent, 
externally  motivated  (by  such  things  as  financial  rewards,  better  jobs  and  promotion 
opportunities).  These  characteristics  of  adults  should  be  addressed  in  designing  effective 


instruction  for  adult  learners. 
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Advantages  of  Computers  Specific  to  Adults 

Several  authors  have  reported  on  the  attributes  of  computers  that  make  them  a 
suitable  instructional  method  for  adult  learners  (19,20,34).  The  computer  offers  privacy 
which  may  allow  some  adults  to  feel  free  revealing  information  that  they  would  not  feel 
comfortable  telling  a  counselor.  Adults  can  also  keep  track  of  their  achievements  and 
their  improvements  through  computer  programs  having  self-tracking  devices,  thus 
providing  internal  motivation.  Additionally,  the  computer  has  the  capability  of  being 
learner-controlled  which  appeals  to  the  self-directed  nature  of  adults.  Adults  can  move 
through  computer  programs  at  their  own  pace  and  programs  can  be  branched  to  allow  for 
individualization  of  content  specific  to  learner  needs.  The  learner  also  has  more  control 
over  when  the  learning  takes  place.  The  computer  is  also  another  avenue  of  instruction 
that  many  adults  did  not  experience  during  their  early  years  of  education.  Thus,  computer 
programs  may  alleviate  their  difficulties  experienced  with  earlier,  traditional  types  of 
instruction  (19).  Additionally,  adults  can  benefit  from  the  ability  to  repeat  lessons  and 
the  positive  feedback  offered  by  the  computer  program  when  they  perform  well  (35). 
Other  advantages  of  computer-based  instruction  with  adults  include  the  increased 
interaction  which  appeals  to  the  adult’s  need  for  active  participation  in  learning.  The 
ability  of  the  computer  program  to  adjust  to  various  entry  levels  of  the  learner  also  makes 
the  computer  suitable  for  adults  with  various  backgrounds  and  skills.  In  addition,  the 
computer  allows  learners  to  make  up  missed  lessons.  Furthermore,  the  computer  gives 
consistent  messages  regardless  of  age,  race  or  gender  (36).  While  the  computer  offers 
many  benefits  for  adult  learners  and  has  the  potential  to  be  cost-effective,  the  computer 
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program  must  be  designed  based  on  sound  education  principles  if  instruction  is  to  be 
effective. 

Characteristics  of  Effective  Computer-Aided  Instruction 

Hannafin  and  Peck  describe  twelve  specific  characteristics  that  define  effective 
computer-aided  instruction  (CAI)  (25).  These  characteristics  are  described  below. 

One  characteristic  is  that  the  instruction  is  based  on  clearly  defined,  measurable 
objectives.  Objectives  help  the  designer  decide  on  appropriate  activities  within  a  lesson. 
They  aid  the  learner  by  pointing  out  important  topics  and  helping  them  focus  on  the 
behavior  to  be  performed  once  the  lesson  is  complete.  Measurable  objectives  also 
provide  a  means  for  evaluating  the  lesson  and  the  learner. 

A  second  characteristic  is  that  effective  CAI  matches  learner  characteristics.  CAI 
is  designed  for  specific  subpopulations  and  must  be  appropriate  given  the  characteristics 
of  the  learners  for  which  it  was  developed.  To  do  this,  the  designer  must  accurately 
estimate  the  knowledge  and  skills  of  the  target  learner.  Care  must  be  taken  to  design 
vocabulary  and  sentence  structure  appropriately.  Complex  wording  will  hinder 
instruction  while  simplistic  wording  may  be  viewed  by  the  learner  as  condescending. 
Likewise,  the  choice  of  input  devises  (touch  screen,  keyboard,  or  mouse)  must  match  the 
capabilities  of  the  learners. 

Third,  effective  CAI  maximizes  interactivity.  One  of  the  greatest  advantages  of  the 
computer  over  print  material  is  its  ability  to  interact  with  the  learner.  However,  discretion 
must  be  used  in  the  design  process.  While  there  must  be  enough  interaction  to  keep  the 


16 


instruction  from  being  an  “electronic  page  turner,”  the  learner  must  not  be  required  to 
answer  questions  continuously  that  have  nothing  to  do  with  the  objectives. 

Fourth,  effective  CAl  is  individualized.  CAI  can  be  designed  to  accommodate  an 
individual’s  personal  need  for  instruction  and  remediation.  Features  such  as  help  buttons, 
menus  and  the  ability  to  leave  comments  for  the  designer  all  help  to  make  the  lesson 
learner-controlled. 

Fifth,  effective  CAI  maintains  learner  interest.  The  novelty  of  computers  for 
education  soon  wears  off  and  the  instruction  itself  must  prove  interesting  and  motivating 
if  learning  is  to  take  place. 

Sixth,  effective  CAI  approaches  the  learner  positively.  The  tone  of  the  lesson  and 
feedback  should  be  positive,  non-threatening  and  should  avoid  sarcasm.  The  dialogue 
that  takes  place  between  the  computer  and  learner  should  mimic  that  of  a  tutor  and 
learner. 

Seventh,  effective  CAI  provides  for  a  variety  of feedback.  While  children  like 
consistent,  constant  positive  feedback,  adults  prefer  varied,  intermittent  positive  feedback 
accompanied  by  a  more  efficient  instruction. 

Eighth,  effective  CAI  fits  the  instructional  environment.  For  instance,  if  learning 
is  to  take  place  while  the  teacher  is  engaged  in  other  activities,  the  lesson  must  be  able  to 
stand  on  its  own.  For  adults  with  busy  schedules,  lessons  should  be  modular  so  that  they 
can  return  to  a  specific  lesson  without  repeating  lessons  already  completed.  If  CAI 
lessons  are  to  be  completed  in  busy  labs  or  workrooms,  the  computer  should  make  little 
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use  of  audio  or  music  or  headphones  should  be  provided  so  as  not  to  distract  other 
learners. 

Ninth,  effective  CAI  evaluates  performance  appropriately.  Learning  can  be 
difficult  to  measure.  Care  must  be  taken  to  write  meaningful,  measurable  objectives  and 
the  attainment  of  those  objectives  must  be  accurately  assessed.  Questions  asked  must  be 
directly  related  to  and  in  the  same  format  as  the  behavioral  objective.  For  instance,  if  the 
objective  states  that  the  learner  will  “draw  a  diagram  of  the  Food  Guide  Pyramid”  and 
there  is  no  means  for  the  learner  to  draw  on  the  computer  screen,  the  objective  must  be 
re-stated  or  the  question  re-evaluated.  The  questions  must  be  worded  correctly  and 
should  avoid  ambiguity  and  the  answers  learners  must  choose  from  must  be  judged  for 
clarity.  The  designer  should  try  to  provide  corrective  feedback  for  incorrect  responses. 

Tenth,  effective  CAI  uses  the  computer ’s  resources  wisely.  The  designer  should 
take  advantage  of  graphics,  sound,  flashing  words,  and  colors  to  amplify  ideas  normally 
expoimded  upon  by  text. 

Most  importantly,  effective  CAI  is  based  on  principles  of  instructional  design. 
The  lesson  should  motivate  the  learner,  inform  the  learner  of  the  objectives,  review 
prerequisite  skills,  present  the  instruction  in  an  organized  manner,  evaluate  progress 
frequently,  provide  feedback,  allow  for  practice  and  evaluate  final  performance  of  the 
learner  and  the  lesson  itself 

Lastly,  effective  CAI  should  be  thoroughly  evaluated.  For  example,  the  designer 
should  formatively  evaluate  the  lesson  for  accuracy,  cosmetic  appeal,  learners’ 
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achievements  and  attitudes,  accurate  branching  destinations,  and  adequate  navigational 
cues. 

Design  Principles  Based  in  Behavioral  and  Cognitive  Psychology 

Effective  instructional  design  is  based  on  behavioral  and  cognitive  learning 
theories  which  describe  how  people  learn  (16,23,25,28).  Behavioral  psychology  is  based 
on  the  premise  that  learning  occurs  as  a  result  of  pairing  a  stimulus  with  a  response. 
Principles  of  instruction  based  in  behavioral  psychology  include  contiguity,  repetition, 
feedback  and  reinforcement,  and  prompting  and  fading  (25).  Contiguity  means  that  the 
response  should  follow  the  stimulus  as  close  in  time  as  possible  to  increase  the 
probability  that  the  stimulus  will  be  paired  with  the  response.  Another  principle  based  in 
behavioral  psychology  is  repetition.  The  practice  of  pairing  the  stimulus  and  the  response 
strengthens  learning  and  improves  retention.  Feedback  and  reinforcement  are  hallmarks 
of  any  good  instruction.  This  third  principle  implies  that  learners  should  know  if  they 
answered  (the  response)  the  question  (the  stimulus)  correctly  or  incorrectly.  Feedback 
should  be  given  if  the  learner  answered  correctly  to  encourage  repetition  of  this  response. 
More  over,  feedback  should  be  given  for  incorrect  responses  as  well  because  without 
corrective  feedback,  the  incorrect  response  is  likely  to  continue.  The  last  principle  based 
on  behavioral  psychology  that  guides  effective  instructional  design  is  prompting  and 
fading.  This  is  the  process  of  providing  the  learner  with  progressively  less  stimuli  to 
produce  a  certain  response.  While  behaviorists  emphasize  the  role  the  environment 
(stimuli)  plays  in  shaping  om  observable  behaviors  (responses),  cognitive  psychologists 
look  at  how  we  process  information  we  received  from  the  environment  (37). 
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Cognitive  psychology  examines  how  information  is  perceived,  interpreted, 
mentally  stored,  and  retrieved.  The  Information  Processing  Model  is  based  on  the  idea 
that  we  receive  stimuli  from  our  environment  and  we  process  it  through  our  sensory 
register.  Subconsciously,  we  then  select  which  information  will  be  attended  to  and  which 
will  not.  Our  prior  knowledge  on  a  subject,  what  we  expect  to  occur,  the  use  of  cues,  and 
how  the  information  is  organized  and  then  presented  all  influence  information  to  which 
we  will  attend.  The  information  is  then  temporarily  stored  in  short-term  memory  which 
has  limited  capacity  (7  +  2  units  of  information)  (38).  Short-term  memory,  often  called 
working  memory,  is  where  information  coming  in  (the  lesson),  information  already  in 
long-term  memory  (prior  knowledge)  and  the  long-term  storage  of  lesson  content  are 
exchanged  and  regulated.  Just  because  lesson  information  is  in  short-term  memory  does 
not  imply  that  learning  has  taken  place  (38).  Learning  is  said  to  take  place  when  the 
information  is  processed  and  mentally  attended  to  in  short-term  memory  and  then 
transferred  into  long-term  memory. 

Practical  applications  for  designing  effective  computer-based  instruction  have 
emerged  from  behavioral  and  cognitive  learning  theories.  The  lesson  should  be 
individualized  as  much  as  possible  (16,25).  Computer-based  instruction  designed  to 
adapt  to  the  individual  leaner  has  been  shown  to  be  effective  (39).  Characteristics  such  as 
lesson  content,  lesson  pace,  presence  or  absence  of  music  for  reinforcement,  amount  of 
practice  provided,  amount  and  types  of  reinforcement,  amount  of  information  on  the 
screen  at  a  given  time,  and  selection  of  pertinent  examples  should  be  tailored  to  the 
learner  or  target  population  (25). 
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Most  learners  not  only  learn  by  listening  but  also  by  doing,  therefore,  the  lesson 
should  be  interactive  (16,25).  When  the  lesson  is  designed  to  be  interactive,  it  increases 
the  potential  for  learning  by  increasing  the  probability  that  the  learner  will  attend  to  the 
instructional  message.  Interactivity  encourages  recall  and  increases  the  time  the  learner  is 
actively  involved  in  the  learning  process. 

Another  practical  application  of  behavioral  and  cognitive  psychology  concerns  the 
use  of  feedback.  Feedback  should  not  be  used  to  scold  the  learner.  It  should  be  given  as 
soon  as  possible  after  the  question  is  answered  and  used  to  tell  the  learner  whether  the 
answer  is  correct  and  why  (40).  Although  feedback  as  to  why  an  answer  is  correct  is  not 
always  necessary,  it  should  be  used  intermittently  to  keep  lessons  efficient  and  keep 
learners  firom  being  bored.  Furthermore,  feedback  should  be  no  more  enticing  for  an 
incorrect  response  than  a  correct  response,  especially  with  young  learners.  Finally,  the 
type  of  feedback  given  should  match  the  learner’s  response. 

Well-designed  computer-based  instruction  encourages  success  (25).  The  more 
answers  a  learner  gets  correct,  the  stronger  the  stimulus-response  pattern.  The  designer 
can  aid  this  process  in  several  ways.  The  material  should  be  organized  to  progress  from 
simple  to  complex  tasks  or  ideas.  Appropriate  “chunking”  (amount  of  information 
presented  at  one  time)  of  material  (23,25)  should  be  used  based  on  the  characteristics  of 
the  learner.  Finally,  learners  should  be  informed  of  the  objectives  early  on  in  instruction 
so  that  they  can  focus  on  important  topics  of  the  instruction. 

The  content  should  also  be  congruent  throughout  the  lesson,  including  the 
objectives,  instruction,  and  test  items  (25).  The  purpose  of  this  principle  is  to  aid  in  the 
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transfer  of  learning  from  the  learning  environment  to  the  real  world.  To  do  this,  the 
performance  on  the  test  item  should  match  the  behavior  stated  in  the  objective.  For 
example,  if  the  objective  states  to  “identify”  five  foods  found  in  the  bread  group,  the  test 
item  should  be  fill-in-the  blank,  completion,  multiple  choice  or  matching  (23).  The 
designer  should  use  a  consistent  question  format,  avoid  giving  away  the  answer  and  avoid 
overly  simplistic  or  too  complex  questions. 

Soimd  instructional  design  allows  for  an  appropriate  amount  of  learner  control 
(16,25).  Topics  such  as  sequence  decisions  and  the  presence  of  remedial  instruction 
should  be  controlled  by  the  designer.  Matters  of  convenience,  such  as  the  ability  to  exit, 
back  up,  and  go  forward,  should  be  left  to  the  learner.  Learners  should  be  able  to  turn  off 
sound  if  they  desire  and  return  to  lessons  with  a  minimal  amount  of  repetition.  They 
should  be  informed  of  the  amount  of  time  it  takes  to  complete  a  lesson. 

Well  designed  instruction  should  also  account  for,  monitor,  and  evaluate  affective 
considerations  of  the  lesson  (25).  This  means  that  the  designer  should  assess  learner 
attitudes  about  the  instruction,  have  a  means  for  learners  to  express  their  attitudes,  and 
adjust  lessons  based  on  a  consensus  of  responses.  Additionally,  lessons  should  have  good 
graphics,  use  lists  to  minimize  words  on  the  screen,  and  use  humor  with  discretion. 

Sovmd  instructional  design  also  employs  frequent  evaluation  of  the  instruction, 
cosmetic  aspects  of  the  lesson,  and  curricular  and  programming  adequacy  to  ensure  the 
instructional  effectiveness  (25).  In  other  words,  the  lesson  should  be  formatively 
evaluated.  Dick  and  Carey  (23)  describe  formative  evaluation  as  the  “process  instructors 
use  to  obtain  data  in  order  to  revise  their  instruction  to  make  it  more  efficient  and 
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effective.  The  emphasis  in  formative  evaluation  is  on  the  collection  of  data  in  order  to 
revise  the  instructional  materials,  to  make  the  materials  as  effective  as  possible”  (p.256). 
Conversely,  summative  evaluation  occurs  after  the  final  product  has  been  released  and 
other  evaluators  test  it  for  its  effectiveness.  Computer  programs  should  be  summatively 
evaluated  once  the  instruction  has  undergone  formative  evaluation  and  changes  have  been 
made  (41).  Questions  which  should  be  explored  and  answered  in  both  the  formative  and 
smmnative  evaluations  include:  “Did  the  lesson  meet  its  objectives?  Did  the  learners  like 
the  instruction?  Did  the  program  run  well?  Were  there  any  unresolved  branches?” 

The  instructional  designer  should  also  use  sound  screen  design  principles  such  as 
simplicity,  consistency,  and  clarity  (26).  The  information  presented  should  be  simple  and 
straightforward  and  there  should  only  be  one  idea  presented  at  a  time.  The  designer 
should  use  supplemental  material  for  text  intensive  information  (42),  while  avoiding 
needless  graphics,  animation,  sound,  color,  and  activities  (26).  The  look  and  feel  across 
screens  should  be  consistent  within  a  single  program  or  series  of  programs  (18).  For 
example,  the  designer  should  place  navigation  buttons,  orientation  information  and 
feedback  in  the  same  area  on  every  screen.  Color,  headings,  and  cues  (font,  size,  style, 
and  color)  should  be  consistent.  The  style  of  graphics,  the  amount  of  information 
appearing  on  one  screen,  the  terminology,  and  screens  requiring  the  learner  to  interact 
should  all  be  consistent  (26).  This  allows  the  learner  to  concentrate  on  the  lesson  instead 
of  learning  how  to  use  the  program  (29,30).  The  designer  should  use  concrete  language 
versus  ambiguous  terminology,  and  conununicate  goals  and  expectations  clearly.  More 
specifically,  the  designer  should  state  all  instructions  clearly  and  make  instructions 
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available  throughout  the  lesson.  The  learner  should  always  be  clear  on  how  and  when  to 
respond  to  questions  or  prompts.  Learners  should  also  know  their  position  within  an 
instruction  program  and  how  long  the  lesson  is  expected  to  last  (27). 

Gagne’s  Nine  Events  of  Instruction 

Effective  instructional  design  also  includes  the  nine  events  of  instruction  (28). 
Gagne  (28)  states  that  “Learning  theory  and  the  research  arising  from  it  tell  us  that  the 
learning  process  contains  nine  processes  (p.l8).”  For  instruction  to  be  effective,  the 
teacher  must  couple  the  nine  internal  processes  of  learning  with  an  external  instructional 
event  (28).  The  following  are  the  nine  events  of  instruction  that  engage  the  learner’s 
internal  learning  processes. 

First,  the  instructor,  or  the  computer  program  as  instructor  must  gain  the  attention 
of  the  learner  which  corresponds  to  the  internal  process  of  alertness.  One  way  to  do  this 
is  by  using  multiple  senses  (20,43).  Use  of  sight  (with  graphics,  animation)  and  sound 
will  gain  the  learner’s  attention  more  than  using  one  or  the  other.  Adults  are  problem- 
oriented,  so  in  order  to  gain  their  attention  and  keep  them  motivated,  the  instruction 
should  focus  on  showing  the  learner  how  to  solve  a  problem  with  a  skill  taught  in  the 
lesson.  Instruction  can  also  maintain  learners  attention  by  arousing  their  curiosity  and 
using  relevant,  real-life  scenarios  (20). 

Second,  the  program  should  inform  the  learner  of  the  lesson 's  objectives  which 
engages  the  internal  learning  process  of  expectancy.  Ference  and  Vockell  (20)  declare 
that  this  will  motivate  the  adult  learner.  They  state  that  adults  come  to  the  learning 
environment  already  motivated  to  some  extent.  Adults  feel  the  knowledge  gained  will 
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improve  their  quality  of  life.  Instructors  need  to  explain  to  adult  learners,  who  are 
characteristically  life-centered,  how  the  new  skill  can  be  used  in  their  everyday  lives. 
Instructional  designers  must  make  the  objectives  relative  to  real-world  situations  and 
clearly  state  the  benefit  of  learning  the  information.  Learners  should  be  reminded 
throughout  the  lesson  of  the  objectives  to  keep  them  interested  and  as  a  reminder  of  why 
they  are  spending  their  time  learning  a  skill.  Smith  and  Boyce  suggest  that  designers  use 
questions,  text,  graphics,  demonstrations,  and  short  simulations  to  inform  adults  of  the 
lesson’s  objectives  (43). 

Third,  to  help  adult  learners  retrieve  information  to  working  memory,  the 
instruction  must  stimulate  recall  of  important  information.  Adults  bring  with  them  a  vast 
amount  of  life-experience  to  the  classroom  and  use  their  own  experiences  to  solve 
problems  they  encounter  (21).  Features  like  questioning  with  branching,  textual  review, 
learner  option  branching,  and  menu  options  can  be  integrated  into  computer  programs  to 
help  adult  learners  stimulate  recall  of  prior  learning  (43). 

Fourth,  instruction  should  include  stimuli  with  distinctive  features  in  order  to 
elicit  the  internal  process  of  selective  perception  (28).  Adults  are  problem-centered,  skill¬ 
seeking  and  value-driven,  therefore  stimuli  within  the  instmction  should  be  presented 
with  this  in  mind  (20).  The  key  principles  in  the  instruction  should  be  clearly  presented 
and  relevant  to  adults.  In  other  words,  the  instruction  should  ensure  that  adults  are  guided 
to  important  points  through  textual  manipulation  such  as  italics  or  bold  print  (20,43).  The 
instruction  should  show  them  exactly  how  what  they  are  doing  relates  to  the  goals  they 
have  set  for  themselves.  Lessons  should  be  presented  in  an  organized  manner,  avoiding 
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clutter  and  extraneous  information  (16,20).  In  addition,  the  instruction  should  permit 
adult  learners  to  work  at  their  own  pace  as  much  as  possible  by  providing  review  buttons, 
back  buttons  and  help  buttons  (20,43). 

Fifth,  instruction  should  guide  learners  to  evoke  their  internal  process  of  semantic 
encoding.  This  means  that  the  instruction  should  allow  adults  to  feel  they  are  apart  of 
deciding  what,  when  and  how  they  will  learn  the  information.  The  instruction  should  not 
dictate  how  adults  will  learn  or  try  to  solve  their  problems.  Instead,  the  instruction  should 
guide  learners  by  asking  questions  and  providing  hints  or  suggestions  to  help  them  solve 
problems.  The  instruction  should  provide  opportunities  for  practice,  include  memory  aids 
when  possible,  and  encourage  learners  to  create  their  own  memory  recall  techmques  or 
provide  supplemental  materials  to  help  them  remember  facts  and  figures  (20). 

The  sixth  event  of  instruction  is  to  elicit  performance  fi'om  adults  in  order  to 
engage  their  internal  process  of  retrieval  and  response.  When  adults  perform  a  skill  or 
answer  a  question,  the  instruction  is  appealing  to  their  need  to  leam  new  skills  to  solve 
real-world  problems.  Instructional  designers  should  ask  questions  in  the  context  in  which 
information  will  be  applied  after  the  lesson  is  completed  to  aid  in  the  transfer  of  learning. 
Another  way  to  aid  learning  transfer  is  for  adults  to  perform  the  real  world  skill  during 
the  lesson  and  receive  feedback  on  their  performance  (20). 

The  seventh  event  ofinstmciion,  providing  feedback,  is  one  way  to  reinforce 
behavior  (28).  For  adults  who  are  characteristically  problem-centered  and  task-oriented, 
providing  feedback  is  one  way  of  letting  them  know  that  their  performance  is  on  or  off 
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track.  Providing  frequent  feedback  for  small  chunks  of  information  is  usually  enough  to 
keep  adults  motivated  (20). 

Instructors  or  the  computer  program  acting  as  the  instructor  must  assess  a 
learner's  performance  to  elicit  the  eighth  internal  process  of  learning  called  cueing 
retrieval.  Assessment  occurs  after  the  instruction  and  is  more  formal  than  feedback 
which  occurs  during  the  lesson.  Different  types  of  assessments  include  tests,  quizzes, 
oral  questions,  and  demonstrations.  The  specific  method  chosen  should  include  items 
that  are  relevant  to  the  actual  skill  to  be  performed. 

The  last  event  of  instruction,  prompting  retention  and  transfer,  helps  adults 
generalize  information,  which  is  the  last  internal  event  of  the  learning  process.  One  way 
to  do  this  is  to  have  learners  solve  problems  they  will  encounter  after  the  lesson  is 
complete.  In  addition,  the  instruction  should  provide  opportunities  for  practice  by 
making  sure  latter  lessons  incorporate  skills  of  earlier  lessons,  provide  practice  for  a  wide 
variety  of  settings  and  by  simply  reviewing  information  (20). 

In  summary,  effective  computer-aided  instruction  utilizes  the  characteristics  of 
effective  computer-aided  instruction  (25),  applies  the  principles  of  behavioral  and 
cognitive  psychology,  and  includes  the  nine  events  of  instruction  outlined  by  Gagne  (28). 
In  order  to  design  computer-aided  instruction  based  on  these  principles,  a  systematic 
model  of  instructional  design  should  be  used. 

Systems  Models  for  Instructional  Design 

Systematic  models  of  instructional  design  when  applied  to  computer-aided 
instruction  ensure  that  the  final  product  will  be  as  usable  and  as  effective  as  possible  (44). 
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The  term  “systematic”  implies  the  use  of  a  system  to  produce  effective  instruction.  A 
system  is  a  group  of  interrelated  components  working  together  to  achieve  a  common  goal. 
In  any  instruction,  the  components  of  the  system  are  the  learners,  teachers,  instructional 
materials  and  the  learning  environment  (23).  Input  on  the  learner’s  characteristics  and 
needs,  the  available  funds  for  instructional  materials  and  the  means  by  which  instruction 
will  take  place,  comes  from  a  variety  of  sources  (company  goals,  focus  groups,  and 
surveys)  in  order  to  prepare  the  instruction.  The  output  is  an  educational  product  and  the 
procedures  to  produce  that  product.  The  evaluation  results  are  used  to  determine  whether 
the  system  achieved  its  goals  and,  if  not,  what  should  be  changed  and  how.  There  are 
many  instructional  design  models  that  employ  a  “systematic”  way  of  designing 
instruction  (16,23,25,45,46).  Although  the  sequence  used  in  the  models  may  vary,  the 
basic  steps  are  the  same  (23,25).  These  steps  are  referred  to  as  “A.D.D.I.E”  which  stands 
for  analysis,  design,  develop,  implement  and  evaluate.  Most  systems  model  of 
instruction  is  based  upon  more  than  25  years  of  research  into  the  process  of  learning  (23). 
Additionally,  each  component  of  the  model  is  based  upon  a  theory  and  the  research 
associated  with  that  theory  to  support  its  effectiveness  (23). 

Dick  and  Carey  Systematic  Model  of  Instructional  Design 

The  Dick  and  Carey  (23)  model  of  instructional  design,  in  use  since  1968  (24), 
employs  a  systems  approach  to  the  design,  development,  implementation  and  evaluation 
of  instruction.  It  describes  a  series  of  steps  that  receive  input  from  the  previous  step  and 
provide  output  for  the  next  step  to  produce  effective,  congruent  instruction.  It  also 
includes  an  evaluation  step  to  determine  if  the  instruction  was  effective,  and  if  not,  what 
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and  where  it  went  wrong.  The  Dick  and  Carey  model  is  a  simple  model  designed  for  use 
by  the  novice  program  designer  or  instructor  who  is  not  trained  in  instructional  design.  It 
can  be  adapted  for  any  type  of  instruction  and  method  of  delivery.  In  addition,  the  model 
incorporates  the  nine  events  of  instruction  described  earlier  (28).  The  model  (Figure  1) 
contains  nine  steps  that  are  described  below. 

The  first  step  is  to  identify  an  instructional  goal.  The  goal  should  be  stated  in 
such  a  way  as  to  identify  skills,  knowledge,  or  attitudes  the  group  of  learners  must 
acquire  in  order  to  satisfy  a  need.  A  need  is  defined  as  the  gap  between  what  is  and  what 
we  would  like  things  to  be  (23).  The  instructional  goal  should  be  broadly  based, 
demonstrable,  and  measurable.  The  instructional  goal  may  be  selected  fi*om  a  list  of 
goals,  obtained  fi-om  a  needs  assessment  with  regard  to  a  particular  topic,  come  from 
practical  experience  with  the  teacher  identifying  learning  difficulties  in  the  classroom 
fi'om  an  analysis  of  someone  doing  a  particular  job  or  skill,  or  fi'om  a  requirement  for  new 
instruction.  The  instructional  goal  provides  the  foundation  for  all  other  steps  in  the 
design  sequence.  Therefore,  care  must  be  taken  to  ensure  it  is  behaviorally-based  and 
clearly  stated. 

Once  the  instructional  goal  is  clearly  stated  (step  1),  an  analysis  of  the  instruction 
(step  2)  must  take  place.  The  major  reason  for  this  step  is  to  identify  all  the  skills  and 
knowledge  that  need  to  be  included  in  the  instruction  in  order  for  a  learner  to  perform  the 
goal.  There  are  two  major  parts  in  step  2.  First,  the  designer  must  identify  the  relevant 
steps  in  performing  the  instructional  goal  (determined  in  step  1),  called  analysis. 
Second,  the  designer  must  perform  a  subskills  analysis  to  identify  the  subordinate  skills 
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(and  entry  behaviors)  that  must  be  learned  in  order  to  reach  the  goal.  Entry  behaviors  or 
prerequisite  skills  are  those  determined  by  the  designer  as  necessary  to  “enter” 
instruction. 

During  the  goal  analysis,  the  designer  must  identify  what  the  person  would  be 
doing  if  they  already  knew  how  to  perform  the  goal.  Typically  there  are  five  to  15  steps 
in  this  sequence  that  can  be  best  represented  by  a  horizontal  flow  diagram  (Figure  2). 

The  designer  should  then  classify  each  step  according  to  its  domain  of  learning  (47). 
Gagne’s  domains  of  learning  are  psychomotor,  intellectual,  verbal  information  and 
attitudinal.  This  will  enable  the  instructor  to  better  identify  the  subskills  needed  for  the 
subskills  analysis. 

The  subskills  analysis  (step  2,  part  1)  of  each  step  in  the  goal  analysis  is  truly  an 
art.  Each  step  in  the  goal  analysis  sequence  is  further  broken  down  into  more  specific 
steps  by  asking  questions  such  as  “What  would  the  learner  have  to  know  or  be  able  to  do 
in  order  to  perform  this  step  in  the  goal?”  If  the  steps  include  skills  not  truly  necessary  to 
imderstand  the  instruction,  the  lesson  becomes  too  long.  Therefore,  nice-to-know 
information  should  not  be  included  if  it  is  not  necessary  to  perform  the  step  in  the  goal. 
Conversely,  if  required  skills  are  omitted,  learners  may  not  learn  basic  skills  necessary  to 
achieve  the  instructional  goal  and  the  instruction  will  not  be  effective.  The  overall  goal’s 
learning  domain  dictates  the  technique  used  to  identify  the  subskills  needed.  Intellectual 
skills  and  psychomotor  skills  use  a  hierarchical  analysis  approach.  A  cluster  approach  is 
used  for  verbal  information  goals,  and  attitudinal  goals  utilize  a  combination  of  the  two 
(23).  The  result  is  a  chart  (Figure  3)  showing  each  step  in  the  goal  and  the  specific  pieces 
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of  information  and  skills  needed  to  perform  the  goal.  A  broken  line  above  them  in  the 
flowchart  denotes  entry  behaviors  or  prerequisite  skills. 

Step  three  in  the  Dick  and  Carey  model  is  to  analyze  the  learners  and  the  context 
of  learning.  Instead  of  determining  the  learner’s  age,  gender,  race,  and  previous 
educational  experience,  which  may  stereotype  learners,  Soulier  approaches  the  analysis  of 
learners  from  a  slightly  different  point  of  view  (48).  He  recommends  determining 
characteristics  of  learners  based  on: 

♦  Entry  knowledge  and  skills 

♦  Social  and  cultural  background 

♦  Cognitive  development  level 

♦  Physical  perception  abilities 

♦  Personal  interest  and  goals 

♦  Attitudes,  prejudices  and  biases 

♦  Individual  time  and  resource  constraints 

♦  Computer  background,  knowledge  and  experience  (if  this  education  mediiun 
is  used). 

Dick  and  Carey  offer  another  set  of  characteristics  designers  might  use  to  assess 
their  learners.  These  include: 

♦  Entry  behaviors 

♦  Prior  knowledge  of  the  topic 

♦  Attitudes  toward  content  and  potential  delivery  systems 


♦  Academic  motivation 
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♦  Educational  and  ability  levels 

♦  General  learning  preferences 

♦  Attitudes  towards  the  organization 

♦  Group  characteristics 

The  designer  must  also  analyze  the  context  in  which  the  instruction  will  take  place 
and  most  importantly  where  the  skills  will  eventually  be  used.  The  learning  context  and 
the  context  in  which  learners  perform  the  skills  shape  what  is  taught  and  how  it  is  taught. 
Dick  and  Carey  recommend  assessing  the  characteristics  of  the  setting  in  which 
instruction  will  take  place  and  the  context  in  which  skills  and  knowledge  will  be  used  by 
addressing  the  following: 

♦  Managerial  or  supervisor  support  (this  can  also  be  social  support  networks) 

♦  Physical  aspects  of  the  learning  site  (Will  there  be  one  site  or  multiple  sites?) 

♦  Social  aspects  of  the  site 

♦  Relevance  of  skills  to  the  workplace  or  home 

♦  Content  analysis  of  the  learning  environment  (what  is  present  and  what  should 
be  present  to  support  the  instruction) 

♦  Compatibility  of  the  site  with  instructional  mandates 

♦  Adaptability  of  the  site  to  simulate  the  workplace  or  home 

♦  Adaptability  for  delivery  approaches  (Can  the  site  be  adapted  to  accommodate 
computers  or  a  kitchen  for  cooking  demonstrations?) 

♦  Learning-site  constraints  affecting  design  and  delivery 
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After  assessing  learner  characteristics  and  the  instructional  context,  the  designer 
should  write  performance  or  behavioral  objectives  (step  4).  Good  behavioral  objectives 
include  the  skill  to  be  learned,  the  conditions  under  which  the  skill  must  be  performed, 
and  the  criteria  for  successful  performance.  First,  the  designer  must  write  a  terminal 
objective  that  corresponds  to  the  overall  instructional  goal.  This  objective  has  all  three 
components  of  a  good  objective  and  its  conditions  reflect  the  context  of  the  learning 
environment.  Next,  an  objective  should  be  written  for  each  step  in  the  goal  analysis  for 
which  no  subskills  are  shown.  Then  the  designer  must  write  an  overall  objective  for  each 
step  containing  subskills  or  write  an  objective  for  each  step  and  an  objective  for  each 
subskill.  In  addition,  the  designer  must  write  objectives  for  each  subordinate  skill  which 
supports  a  subskill  if  there  are  any.  Objectives  may  or  may  not  be  wntten  for  entry 
behaviors. 

Step  five  of  the  Dick  and  Carey  model  is  to  develop  assessment  instruments.  This 
ensures  consistency  between  the  goals  of  the  instruction  and  the  way  these  goals  are 
tested.  Many  times  in  traditional  education,  content  is  determined,  then  objectives  are 
written,  next  the  instruction  is  given  and  finally,  a  test  is  developed.  Often  the  test  is 
based  on  topics  the  instructor  remembers  teaching  or  placing  emphasis  on,  but  it  may  lack 
relevance  to  the  overall  goals  of  instruction.  The  assessment  instruments  should  be  based 
on  the  objectives  of  the  lesson  and  measure  the  learner’s  ability  to  perform  what  is 
described  in  the  objective.-  This  type'of  testing,  called  criterion-Teferenced  testing,  is  used 
to  assess  learners’  progress  and  provide  information  about  the  effectiveness  of 
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instruction.  Test  items  should  correspond  one-to-one  with  objectives.  The  performance 
required  in  the  objective  must  match  the  performance  required  on  the  test. 

According  to  Dick  and  Carey,  two  types  of  criterion-referenced  tests  are  used. 

The  pre-test  assesses  the  presence  of  entry  behaviors  and  selected  instructional  objectives. 
The  pmpose  of  the  pre-test  is  to  ascertain  whether  entry  behavior  skills  were  assumed 
correctly  by  the  designer  and  if  the  learner  can  already  perform  certain  objectives  in  the 
instruction.  If  learners  can  not  perform  the  entry  behaviors,  this  tells  the  designer  that 
they  need  to  review  entry  behaviors  before  beginning  a  lesson.  If  learners  can  already 
perform  certain  objectives  in  the  lesson,  this  tells  the  designer  these  skills  may  not  need 
to  be  taught.  This  makes  the  lesson  more  population  specific  and  efficient. 

The  second  type  of  criterion-referenced  test  measures  the  learners’  ability  to 
perform  the  terminal  objective,  which  includes  all  instructional  objectives  and  is 
synonymous  with  the  overall  goal  of  instruction.  The  purpose  of  this  test,  often  called  a 
post-test,  is  to  help  the  designer  identify  the  areas  of  the  instruction  that  are  not  working. 
If  a  learner  fails  to  perform  the  terminal  objective,  the  designer  can  look  at  missed  test 
items,  then  match  them  up  with  their  corresponding  objectives  to  identify  the  exact 
location  in  the  instruction  where  errors  occurred.  Tests  used  in  the  developmental  phase 
of  instructional  design  must  be  modified  and  simplified  before  the  program  is  ready  for 
final  implementation. 

Step  six  of  the  Dick  and  Carey  model  is  to  develop  an  instructional  strategy 
which  is  a  plan  for  how  the  instruction  will  be  presented.  There  are  three  parts  to  this 
step:  media  selection,  instructional  sequencing  and  “chunking”,  and  developing  the 
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instructional  strategy.  The  designer  must  first  decide  how  the  information  is  best 
presented.  One  method  proposed  for  doing  this  is  to  choose  the  media  for  instruction 
based  on  the  desired  domain  of  learning  (49).  The  instructional  sequence  and  the  amount 
of  information  to  be  presented  at  one  time,  called  “chunking,”  is  decided  upon  next.  Dick 
and  Carey  recommend  the  designer  teach  topics  of  the  goal  analysis  (Step  2)  from  bottom 
to  top  and  left  to  right.  With  this  in  mind,  the  designer  then  decides  on  the  chunk  of 
information  to  be  presented  at  one  time.  Five  factors  should  be  considered  when 
determining  the  size  of  the  chunk.  These  include  the  learner’s  age,  the  complexity  of  the 
information,  the  type  of  learning  that  is  occurring,  and  whether  the  activity  can  be  varied. 
Also,  the  time  required  to  include  the  nine  events  of  the  instruction  (28)  must  be 
considered. 

Once  the  media  had  been  selected  and  the  sequence  and  chunking  of  information 
is  determined,  then  the  designer  must  plan  the  overall  instructional  strategy.  There  are 
five  major  steps  to  an  instructional  strategy: 

1 .  Preinstructional  activities 

2.  Information  presentation 

3.  Learner  participation 

4.  Testing 

5.  Follow-through 

The  preinstructional  activities  include  informing  the  learner  of  the  objectives  and 
prerequisite  skills  and  motivating  the  learner.  Keller’s  ARCS  (Attention,  Relevance, 
Confidence,  and  Satisfaction)  model  includes  four  approaches  to  motivating  learners  (50). 
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These  include  gaining  the  learner’s  attention,  showing  them  the  relevance  of  the 
instruction  to  their  lives,  helping  the  learner  to  be  confident  that  they  can  perform  the 
skill  and  lastly,  making  sure  the  learner  derives  satisfaction  from  the  learning  experience. 

The  second  step,  information  presentation,  includes  writing  out  content  and 
relevant  examples,  based  on  the  target  population,  for  each  objective  written.  The 
examples  should  also  be  context  specific  to  aid  in  the  transfer  of  learning.  Additionally, 
the  examples  should  support  the  overall  terminal  objective. 

How  the  learner  will  participate  is  determined  in  the  third  step,  learner 
participation.  The  designer  must  develop  practice  questions  and  feedback  for  every 
objective  written.  After  information  is  presented  in  the  lesson,  and  an  example  is 
provided,  the  learner  should  be  given  an  opportunity  to  practice  the  skill  as  soon  as 
possible.  More  over,  the  learner  should  be  provided  with  individual  feedback. 

The  fourth  step,  testing,  is  decided  upon  next.  This  includes  deciding  if  learners 
will  complete  a  pre-test,  and  how  many  post-tests  and  embedded  tests  will  be  given.  An 
embedded  test  assesses  a  smaller  number  of  objectives  than  a  post-test  and  usually  comes 
after  a  small  unit  of  instruction.  The  designer  should  look  at  the  sequence  and  chunking 
of  information  to  be  presented  when  determining  how  many  and  what  kinds  of  tests  will 
be  given. 

The  fifth  step,  follow-through  activities,  should  be  planned  last.  The  designer 
should  decide  what  additional  materials  will  be  added  to  the  lesson  for  learners  who  do 
not  master  the  objectives  during  the  lesson.  In  addition,  the  designer  should  plan  extra 
information  to  enrich  the  lesson  for  learners  who  master  the  objectives  quickly.  The 


36 


designer  must  employ  memory  devices  that  will  assist  learners  to  memorize  information 
necessary  to  perform  selected  skills.  The  designer  must  also  consider  the  conditions  in 
which  the  learner  will  have  to  perform  the  skill  and  try  to  mimic  that  environment  during 
the  instruction  as  much  as  possible  to  aid  in  transfer. 

Step  seven  of  the  Dick  and  Carey  model  is  developing  and  selecting  the 
instruction.  The  designer  will  use  all  of  the  previous  steps  in  the  model  to  produce  the 
instruction.  Components  of  an  instructional  package  may  include  a  learner’s  manual, 
instructional  materials,  tests,  and  an  instructor  guide. 

Steps  eight  and  nine  of  the  Dick  and  Carey  model  are  to  design  and  conduct 
formative  evaluation,  and  then  revise  the  instruction.  While  these  are  some  of  the  most 
important  aspects  to  instructional  design,  they  are  often  overlooked  (25).  Dick  and  Carey 
describe  formative  evaluation  as  a  process  used  to  obtain  data  in  order  to  revise 
instruction  to  make  it  more  efficient  and  effective  (23).  There  have  been  other 
suggestions  on  how  to  conduct  a  formative  evaluation  (51-53)  but  these  are  modifications 
of  the  model  proposed  by  Dick  and  Carey.  Other  authors  (25,46)  have  also  recommended 
the  Dick  and  Carey  model  of  formative  evaluation.  This  model  includes  three  phases:  a 
one-to-one  evaluation,  a  small  group  evaluation,  and  a  field  trial. 

Briefly,  after  the  instructional  materials  have  been  evaluated  for  content  accuracy 
by  a  content  expert  and  for  relevancy  to  the  target  population  by  a  member  of  the 
population,  one  can  proceed  to  the  first  phase  of  formative  evaluation,  the  one-to-one 
evaluation.  This  phase  uses  three  to  five  members  of  the  target  audience  and  the  designer 
works  individually  with  the  learners.  The  purpose  of  this  evaluation  is  to  identify  and 
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remove  obvious  errors  and  to  obtain  initial  performance  indications  and  reactions  to  the 
content  by  the  learner.  The  designer  is  attempting  to  determine  if  the  instruction  is 
clearly  presented,  the  impact  of  the  instruction  on  the  learner’s  attitudes  about  the 
instruction  and  the  feasibility  of  the  instruction  given  the  available  resources.  The 
learners  usually  evaluate  and  complete  the  pre-test,  embedded  tests,  the  post-test  and  an 
attitude  questionnaire.  The  attitude  questionnaire  assesses  the  learner’s  attention  to  the 
material,  their  perceived  relevance  of  the  material,  the  clarity  of  the  instruction  and  the 
satisfaction  with  the  instruction. 

The  next  phase  of  formative  evaluation  is  the  small  group  evaluation.  This  phase 
involves  8-20  representatives  from  the  target  population.  The  small  group  evaluation  has 
two  purposes.  One  purpose  is  to  determine  the  effectiveness  of  changes  made  after  the 
one-to-one  evaluation  and  to  identify  any  remaining  learning  problems  that  learners  may 
have.  The  second  purpose  is  to  determine  if  the  learner  can  use  the  instructional  program 
in  the  designer’s  absence.  Data  are  gathered  using  the  pre-test,  embedded  tests,  the  post¬ 
test,  and  attitude  questionnaire.  Additionally,  the  instructor  may  interview  the 
participants  verbally  on  certain  parts  of  the  instruction  that  learners  may  not  be  able  to 
answer  through  questionnaires  alone.  Once  the  materials  are  revised,  the  evaluation  can 
proceed  to  the  field  trial. 

While  Dick  and  Carey  place  the  field  trial  phase  into  formative  evaluation  other 
authors  place  it  in  summative  evaluation  and  offer  alternatives  to  a  field  trial.  For 
example,  Alessi  and  Trollip  (16)  perform  the  field  trial  for  interactive  videos  in  the 
summative  evaluation  phase  rather  than  the  formative  evaluation  phase.  Additionally, 
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although  Hannafin  and  Peck  (25)  place  the  field  trial  phase  in  formative  evaluation,  they 
state  that  “informal  evaluations  conducted  to  this  point  should  ensure  that  the  lesson  is 
virtually  finished  or  that  only  minimal  changes  will  be  required”  (pg.302).  Golas  (52) 
contends  that  while  formative  evaluation  is  necessary,  it  can  be  quite  lengthy  and 
expensive  for  instruction  involving  a  computer.  Therefore,  she  offers  a  slightly  different 
approach  when  one  is  designing  CAI.  She  uses  the  same  three  phases  as  proposed  by 
Dick  and  Carey,  however,  the  number  of  people  involved  in  the  testing  is  much  smaller, 
with  the  field  trial  consisting  of  only  3  members  fi-om  the  target  population.  For  all  these 
reasons,  it  is  not  surprising  then,  that  the  field  trial  is  often  the  “first  release”  to  the 
general  public  due  to  time  constraints  and  the  need  to  get  the  material  out  in  the  market 
for  financial  reasons. 

The  main  purpose  of  the  field  trial  according  to  Dick  and  Carey  (23)  is  to 
determine  if  changes  made  after  the  small  group  evaluation  were  effective.  Additionally, 
its  purpose  is  to  determine  if  it  is  possible  to  use  the  instruction  in  the  intended  setting. 
The  field  trial  is  performed  with  30  members  firom  the  target  population.  The  procedures 
and  data  gathered  in  the  field  trial  are  basically  the  same  as  the  small  group  evaluation 
except  for  the  role  of  the  designer.  At  this  point,  the  designer  is  really  trying  to  see  if  the 
materials  can  work  in  his/her  absence. 

Once  the  instructional  materials  are  in  final  form  based  on  revisions  fi'om  the 
formative  evaluation  one  can  conduct  summative  evaluations  of  the  materials. 

Summative  evaluation  is  generally  not  part  of  the  design  process  but  rather  an  evaluation 
of  a  product’s  absolute  and  relative  worth.  Summative  evaluation  is  not  conducted  by  the 
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designer  but  by  an  objective  third  party.  The  results  of  the  summative  evaluation  can  be 
used  as  a  marketing  tool  or  as  an  estimate  of  the  time  needed  to  complete  the  instruction. 

Summary 

In  summary,  the  advantages  of  using  a  systems  model  for  instructional  design  are 
many.  First,  its  initial  focus  is  on  what  the  learner  will  be  able  to  do  when  the  instruction 
is  complete  which  is  one  of  the  nutrition  education  strategies  outlined  by  ADA. 

Secondly,  being  able  to  perform  a  skill  appeals  to  adult  learners  who  are  skill-seeking  and 
problem-oriented.  Next,  it  incorporates  many  years  of  research  on  how  people  learn  best 
and  integrates  this  into  instructional  design.  More  over,  it  is  based  on  cognitive  and 
behavioral  theories  of  psychology.  In  addition,  there  is  a  careful  link  between  each 
component  of  the  system  ensuring  congruency  from  one  part  to  the  next.  Because  of 
these  features,  the  systems  model  of  instructional  design  helps  to  ensure  successful 
learning  outcomes.  Throughout  the  process,  data  are  gathered  to  determine  what  part  of 
the  instruction  is  not  working  and  instruction  is  revised  until  it  works.  For  these  reasons, 
the  systems  model  of  instructional  design  is  a  viable  means  for  designing  instruction  to 
educate  the  public  on  nutrition.  Additionally,  computer-aided  instructional  design,  based 
on  a  systems  approach,  offers  an  innovative  alternative  to  traditional  instruction  that 
apparently  is  not  working  based  on  the  nation’s  progress  toward  meeting  the  national 
nutrition  objectives  outlined  in  Healthy  People  2000  (3). 

It  is  therefore  the  purpose  of  the  present  study  to  design,  develop,  and  formatively 
evaluate  a  computer-based  multimedia  nutrition  education  program  for  adults.  The 
program  is  designed  to  teach  the  skill  of  analyzing  and  then  modifying  one’s  diet  based 
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on  serving  sizes  and  the  principles  of  the  Food  Guide  Pyramid  (31)  and  was  thus  named 
“Put  Nutrition  Into  Practice.”  The  design,  development,  and  formative  evaluation  is 
based  on  the  well-accepted  instructional  design  model  outlined  by  Dick  and  Carey  (23). 
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Figure  1  Nine  Steps  of  the  Dick  and  Carey  Model  of  Instructional  Design  within 
the  Four  Phases  of  Instructional  Design 


Adapted  From:  Dick  W,  Carey  L.  The  Systematic  Design  of  Instruction.  4'*  ed.  New 
York,  NY:  HarperCollins  College  Publishers;  1996. 


Figure  2  Example  of  a  Goal  Analysis  of  the  Instructional  Goal* : 
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Each  step  represents  what  the  learner  would  be  doing  if  he/she  were  successfully  performing  the  instructional  goal. 
Connecting  point  for  the  subskills  analysis  for  each  step  of  the  instructional  goal 


Figure  3  Example  of  the  Subskills  Analysis  for  Step  2  of  the  Instructional  Goal 
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Denotes  steps  that  must  be  learned  in  order  to  perform  step  2.5 1 
Skills  learner  is  assumed  to  posses  prior  to  lesson 
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ABSTRACT 

Objective  The  purpose  of  this  study  was  to  design,  develop,  and  formatively  evaluate  a 
computer-based  multimedia  nutrition  education  program  for  adults  based  on  the  Dick  and 
Carey  (1)  model  of  instructional  design. 

Design  Study  design  included  four  phases:  analysis,  design,  development  and  evaluation. 
In  the  analysis  phase,  the  program’s  instructional  goal  was  established  by  72  volunteers, 
18-50  years  old,  from  local  Air  Force  bases  who  participated  in  two  focus  groups  and  an 
e-mail  survey.  A  dietitian  survey  using  an  Air  Force  dietitian  roster  was  also  conducted. 
Objectives,  assessment  instruments,  content,  examples,  and  practice  questions  with 
feedback  were  written  in  the  design  phase  prior  to  program  development. 

Development  The  instruction  was  programmed  using  HyperStudio’’’”  and  based  on 
characteristics  of  effective  computer-aided  instruction  and  sound  screen  design  principles. 
The  four  modules  of  the  program  were:  Familiarization  with  Food  Groups,  Serving  Sizes, 
Modifying  a  Menu,  and  Vitamins  and  Minerals. 

Evaluation  Eighteen  subjects,  18-50  years  old,  with  a  minimum  of  a  high  school 
education,  and  an  average  or  below  knowledge  of  nutrition,  from  the  local  commumty 
and  a  southeastern  university  volunteered  to  participate  in  the  two  formative  evaluation 
phases.  All  subjects  completed  a  pre-test,  two  post-tests,  three  embedded  tests,  and  an 
attitude  questioimaire.  The  percentage  of  subjects  scoring  each  test  item  correct  was  used 
to  ascertain  weaknesses  in  the  program.  Phase  one  resulted  in  one  module  being  deleted 
because  the  material  was  not  relevant  to  subjects.  The  main.problem  noted  in  phase  two 
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was  identification  of  serving  sizes,  only  4  of  15  and  6  of  15  subjects  mastered  this 
objective  in  module  two  and  on  post-test  one,  respectively.  Back  buttons  and  review 
screens  were  added  to  facilitate  subjects’  identification  of  serving  sizes.  The  two 
modules  found  to  be  the  most  effective  were  Familiarization  with  Food  Groups  and 
Vitamins  and  Minerals. 

Conclusions  The  Dick  and  Carey  model  of  instructional  design  is  an  effective  way  to 
design  computer-based  multimedia  nutrition  education  programs.  Nutrition  educators  are 
encoxuraged  to  use  systematic  models  of  instructional  design  when  designing  nutrition 
education  programs  for  the  public. 
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INTRODUCTION 

The  role  of  diet  in  the  prevention  of  chronic  disease  has  been  well  established 
over  the  past  10  years  (2,3)-  However,  many  of  the  Healthy  People  2000  objectives 
related  to  nutrition  are  not  being  achieved  (4).  Based  on  the  most  recent  data,  the 
percentage  of  overweight  Americans  is  increasing,  fewer  overweight  individuals  are 
using  sound  weight  loss  practices,  and  fewer  Americans  are  consuming  a  diet  concurrent 
with  the  Food  Guide  Pyramid  (4,5).  The  American  Dietetic  Association  (ADA)  recently 
commented  on  the  changes  to  the  Healthy  People  2000  nutrition  objectives  to  be  achieved 
by  the  year  2010  (6).  These  changes  include  additional  emphasis  on  the  number  of 
Americans  eating  adequate  fiuits,  vegetables,  grains  and  calcium-rich  foods,  consuming 
less  than  30%  of  calories  from  fat  and  maintaining  their  desirable  body  weight.  Based  on 
current  data  and  ADA's  proposal  to  strengthen  the  Healthy  People  2000  objectives,  the 
need  for  more  innovative  and  effective  nutrition  education  is  clear. 

Both  ADA  and  the  Society  for  Nutrition  Education  (SNE)  provide  a  framework 
for  educating  the  public  on  diet  and  nutrition  (7,8).  Both  organizations  acknowledge  the 
need  for  resoxurce  development  and  creative  new  programs  to  reach  and  influence 
consumers.  To  be  successful,  nutrition  education  should  go  beyond  merely  providing 
knowledge  passively,  anticipating  knowledge  alone  will  change  behavior.  Rather, 
nutrition  education  must  bridge  the  gap  between  knowledge  and  action  with  behaviorally- 
focused  programs  that  teach  skills  consumers  can  use  to  change  their  diets.  The  programs 
must  also  meet  a  defined  "need"  within  the  target  population,  involve  active  learner 
participation,  and  be  personalized. 
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Computers  offer  a  viable  means  for  educating  the  public  about  diet  and  nutrition. 
When  computer  programs  have  been  used  to  teach  adults  about  nutrition,  they  have  been 
found  to  be  effective  and  well  received  (9-14).  Despite  these  findings,  their  use  in 
nutrition  education  remains  limited  (9, 15,16).  One  reason  may  be  lack  of  acceptance  and 
understanding  of  technology  by  nutrition  educators  (13).  Other  reasons  include  software 
and  hardware  incompatibilities  and  a  shortage  of  people  skilled  in  developing  quality 
software,  resulting  in  low-quality  products  in  the  marketplace  (17).  According  to  Kolasa 
(15)  and  Byrd-Bredbenner  and  Bauer  (9)  computers  are  limited  in  nutrition  education 
because  of  a  dearth  of  well-designed  and  stand-alone  software  programs  with  the  adult 
learner  in  mind.  Although  computers  have  been  used  extensively  for  nutrient  calculations, 
only  a  small  number  of  computer  programs  have  been  used  for  nutrition  education  in 
schools,  clinics,  extension  programs  and  homes,  and  even  fewer  programs  have  been 
developed  specifically  for  adult  learners  (18). 

Computers  offer  many  advantages  that  appeal  to  an  adult's  learning  preferences 
(19-21).  Adults  have  unique  characteristics  and  bring  life  experiences  to  the  learning 
environment,  making  their  perspective  on  learning  different  firom  that  of  children.  Adults 
can  be  described  as  self-directed,  problem-solving,  skill-seeking  and  internally  motivated 
learners  (22).  Correspondingly,  computers  offer  privacy,  a  high  degree  of  learner  control, 
24-hour  availability,  and  self-paced  and  individualized  learning.  Computer  programs  also 
give  consistent,  unbiased  messages,  and  are  free  fi'om  fatigue.  The  programs  can  include 
practice  and  feedback,  which  appeals  to  the  adults'  need  for  active  participation. 
Additionally,  computer  programs  can  accommodate  many  different  learning  styles  with 
the  inclusion  of  sound,  pictures,  and  animation  (18,23). 


50 

A  plethora  of  dietary  analysis  programs  exist,  although  most  are  not  designed  as 
instructional  programs.  Rather,  these  programs  assess  an  individual’s  diet  and  increase 
knowledge  of  dietary  strengths  and  weaknesses.  Most  do  not  teach  learners  the  skills 
necessary  to  modify  their  diets  or  change  their  dietary  behaviors.  To  ensure  the 
development  of  effective  and  innovative  nutrition  education  computer  programs, 
systematic  models  of  instructional  design  should  be  used.  The  Dick  and  Carey  (1)  model 
of  instructional  design  employs  a  systematic,  step-by-step  approach  that  novice 
programmers  and  non-programmers  (i.e.  nutrition  educators)  can  use  to  design  effective 
instruction.  This  model  has  been  in  use  since  1968  (24)  and  is  based  on  more  than  25 
years  of  research  on  the  learning  process  and  instructional  design.  The  initial  focus  is  on 
what  the  learner  must  know  or  be  able  to  do  upon  completion  of  the  lesson.  Because  it  is 
a  systems  based  model,  it  offers  congruency  from  objectives  through  evaluation.  Data 
are  collected  to  determine  what  instructional  segment,  if  any,  is  not  working  and  through 
formative  evaluation,  the  instruction  is  revised  until  it  works  as  intended. 

It  was  the  purpose  of  this  study  to  design,  develop,  and  formatively  evaluate  a 
computer-based  multimedia  nutrition  education  program  for  adults  based  on  the  Dick  and 
Carey  (1)  model  of  systematic  instructional  design.  The  program  was  designed  to  teach 
the  skill  of  analyzing  and  then  modifying  one’s  diet  based  on  serving  size  recognition  and 
principles  of  the  Food  Guide  Pyramid  (25)  and  was  thus  named  “Put  Nutrition  Into 
Practice.”  This  program  is  offered  as  an  innovative  nutrition  education  strategy  that  will 
enable  adults  to  make  dietary  behavior  changes  in  order  to  meet  Healthy  People  2010 


objectives. 
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METHODS 

The  overall  study  design  included  four  phases:  analysis,  design,  development  and 
evaluation.  The  study  was  approved  by  the  institutional  review  board  at  Georgia  State 
University.  The  target  population  for  the  computer  program  was  adults,  18-50  years  of 
age,  with  at  least  a  high  school  education,  and  an  average  or  below  knowledge  of 
nutrition.  Informed  consent  was  obtained  from  all  study  subjects. 

Phase  I:  Analysis 

The  purpose  of  phase  one  was  to  determine  the  overall  instructional  goal  based  on 
needs  of  the  target  population.  A  three-tiered  needs  assessment  was  used  which  consisted 
of  two  focus  groups,  an  e-mail  survey,  and  a  registered  dietitian  s\irvey.  Two  focus 
groups  were  conducted  and  analyzed  in  accordance  with  procedures  outlined  by  Krueger 
(26).  A  total  of  sixteen  volunteer  subjects  completed  a  demographic  data  questionnaire 
and  participated  in  the  two  focus  group  discussions.  Seven  subjects  were  obtained  by 
random  selection  from  a  personnel  roster  at  Maxwell  Air  Force  Base  (Montgomery,  AL) 
and  by  soliciting  voluntary  participation.  Nine  subjects  were  from  a  convenience  sample 
at  Dobbins  Air  Reserve  Base  (Atlanta,  GA).  The  overall  group  was  diverse  in  their 
nutrition  knowledge,  education  levels  and  ages.  All  subjects  met  target  population 
criteria,  were  21-39  years  of  age  and  had  a  minimum  of  a  high  school  education.  Eleven 
of  the  sixteen  subjects  had  never  received  any  form  of  nutrition  education.  Two  had 
received  nutrition  counseling  for  weight  loss  from  a  dietitian  and  three  reported  learning 
about  nutrition  in  high  school.  Focus  group  questions  are  shown  in  Table  1.  Each  session 
lasted  approximately  one  hour  and  was  recorded.  Information  was  transcribed  and 
common  themes  for  each  question  were  identified. 
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Similar  data  were  collected  using  a  modified  Delphi  technique  (e-mail  survey) 
(27).  A  convenience  sample  of  twelve  Air  Force  personnel  were  sent  the  same  questions 
used  during  the  focus  groups,  and  were  asked  to  forward  the  questionnaire  to  two  or  more 
people  they  knew.  Twenty-five  individuals  responded  and  by  virtue  of  responding  agreed 
to  participate  in  the  study.  Similar  responses  on  the  nutrition  topics  of  interest  and  factors 
facilitating  transfer  of  learning  were  combined.  These  responses  were  sent  back  to  ten 
randomly  selected  subjects  from  the  original  25  respondents.  Participants  had  to  agree  or 
disagree  with  the  overall  topics,  then  they  ranked  them  in  order  of  importance.  The  most 
requested  nutrition  topic  and  most  important  factor  that  would  improve  transfer  of 
learning  were  selected  from  the  final  responses  received. 

Needs  assessment  surveys  were  also  sent  to  35  Registered  Dietitians.  The  sample 
was  obtained  from  a  roster  of  military  dietitians  aroimd  the  coimtry  who  occupied 
positions  in  health  and  wellness  centers  and  out-patient  nutrition  clinics.  Thirty-one 
subjects  completed  the  survey.  The  main  survey  questions  are  shown  in  Table  1. 

Results  from  focus  groups  and  the  e-mail  survey  are  shown  in  Table  2.  The  most 
common  topics  discussed  in  basic  nutrition  counseling  by  dietitians  were  food  groups, 
serving  sizes  and  label  reading.  The  topics  rarely  covered  included  meal  planning  and 
vitamin  and  mineral  content  of  food.  The  main  three  topics  dietitians  thought  should  be 
covered  by  a  basic  nutrition  computer  program  were  identifying  food  groups,  identifying 
servings  sizes,  and  practice  questions.  Twenty-three  of  3 1  dietitians  saw  a  need  for  a 
computer  program  to  teach  basic  nutrition  skills,  however  eight  did  not.  The  reasons 
cited  included  existing  educational  materials,  dietetic  technicians  who  performed  this 
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counseling,  existing  computer  programs  (although  only  three  were  using  them),  fear  of 
losing  their  jobs  and  the  fact  that  they  liked  interacting  with  clients. 

When  requested  information  from  the  target  population  was  matched  with 
dietitian  responses,  there  was  a  gap  between  what  was  wanted  and  what  was  being 
provided  particularly  in  the  area  of  meal  planning  and  vitamin  and  mineral  requirements. 
This  led  to  the  overall  instructional  goal  for  “Put  Nutrition  Into  Practice”:  The  learner 
will  choose  to  apply  the  principles  of  the  Food  Guide  Pyramid  to  his/her  daily  food 
choices. 

Phase  II:  Design 

The  purpose  of  the  design  phase  is  to  outline  the  lesson  in  complete  detail  before 
actually  developing  the  materials.  It  is  composed  of  five  steps:  instructional  analysis, 
analysis  of  the  learner  and  context  in  which  the  learner  will  perform  the  skill,  writing 
performance  objectives,  developing  assessment  instruments  and  developing  the 
instructional  strategy. 

In  the  instructional  analysis,  the  instructional  goal  from  Phase  I  was  broken  down 
first,  into  five  “steps”  (Figure  1).  Second,  each  of  these  steps  was  broken  down  further 
into  subskills  by  asking,  “What  does  the  learner  have  to  know,  or  be  able  to  do  in  order  to 
perform  this  step?”  Figure  2  is  the  complete  breakdown  of  the  second  step  of  the 
instructional  goal. 

The  analysis  of  learners’  prior  knowledge,  motivational  factors  and  comfort  level 
using  a  computer  came  from  focus  groups  and  e-mail  participants  during  Phase  I,  as 


shown  in  Table  2. 
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For  each  step  in  the  subskills  analyses  (Figure  2)  a  performance  objective  was 
written,  resulting  in  a  total  of  16  objectives.  The  objectives  were  written  in  the  three-part 
format  outlined  by  Mager  (28).  The  three  parts  included  the  skill  or  behavior  identified  in 
the  instructional  analysis,  conditions  existing  while  the  learner  carried  out  the  task,  and 
criteria  used  for  performance  evaluation.  For  example,  subordinate  skill  2.1 1  shown  in 
Figure  2,  required  the  learner  to  recognize  portion  sizes.  The  corresponding  objective 
was,  “Given  three  pictures  of  the  same  food,  the  learner  will  identify  which  picture 
represents  one  portion  size  with  100%  accuracy.” 

The  assessment  instruments  developed  were  a  pre-test,  two  post-tests  and  an 
attitude  questionnaire.  For  each  objective  written,  one  to  two  parallel  test  items  were 
developed.  Selected  items  were  then  used  to  develop  the  pre-  and  post-tests.  The  piirpose 
of  the  pre-test  was  to  determine  if  learners  possessed  entry  behavior  skills  or  any 
knowledge  about  lesson  content.  It  contained  ten  items:  three  measured  entry  behaviors 
and  eight  measured  selected  skills  from  Figure  2.  Post-test  one  contained  12  items: 
learners  were  given  a  24  hour  food  record  and  the  daily  servings  goals  of  a  tall,  lean, 
active  man.  Six  items  asked  them  to  identify  the  number  of  servings  from  each  food 
group.  Four  questions  required  them  to  calculate  deficient  servings.  For  two  questions, 
they  chose  foods,  in  the  correct  portion  sizes,  to  supply  the  missing  servings.  Post-test 
two  consisted  of  a  total  of  two  items  per  vitamin  and/or  mineral  reviewed.  First,  learners 
identified  good  food  sources  for  vitamins  and/or  minerals  then  selected  a  food  list  that 
would  increase  the  vitamin  and/or  mineral  content  of  a  given  menu.  An  attitude 
questionnaire  was  also  developed  to  assess  learner’s  attention  to  content,  material 
relevance,  confidence  in  using  skills,  satisfaction  with  and  clarity  of  the  program.  The 
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questionnaire  contained  29  items  and  utilized  a  1  (strongly  negative)  to  5(strongly 
positive)  Likert-type  scale.  The  questionnaire  also  allowed  learners  to  give  written 
feedback  on  strengths  and  weaknesses  of  the  computer  program.  All  assessment 
instruments  were  reviewed  for  content  validity  by  two  nutrition  professionals  and  for 
design  validity  by  an  instructional  designer.  Reliability  was  not  established  due  to  the 
small  number  of  questions  on  each  test  and  the  desire  to  keep  evaluation  time  efficient. 

The  last  step  in  the  design  phase  was  developing  the  instructional  strategy. 
Development  of  the  instructional  strategy  consisted  of  decisions  related  to  “chunking” 
(how  much  information  to  present  at  one  time),  testing  the  information,  selecting 
preinstructional  activities,  writing  out  the  content  to  be  presented  for  each  objective  and 
planning  activities  to  aid  in  the  transfer  of  learning. 

First,  similar  performance  objectives  within  step  2  (Figure  2)  were  grouped  or 
“chunked”  resulting  in  three  sections  or  modules  of  information:  module  one 
“Familiarization  with  Food  Groups”,  module  two  “Serving  Sizes,”  and  module  three 
“Modifying  a  Menu.”  The  complete  breakdown  of  step  four  of  the  instructional  analysis 
(Figure  1)  contained  two  similar  objectives,  therefore  it  became  the  fourth  module, 
“Vitamins  and  Minerals.”  Module  four  contained  built-in  questions  to  help  learners 
identify  vitamins  and  minerals  that  may  be  of  concern,  taught  food  soxirces  of  the 
vitamins  and  minerals  and  how  to  incorporate  these  foods  into  a  menu. 

An  “embedded  test”  was  developed  for  modules  one,  two,  and  three.  These  tests 
allowed  the  designer  to  zissess  the  program’s  effectiveness  after  a  small  number  of 
objectives  were  taught,  providing  additional  insights  into  possible  instructional 
weaknesses.  All  tests  were  reviewed  for  content  validity  by  two  nutrition  professionals. 
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Preinstructional  activities,  which  is  a  plan  for  introducing  the  lesson,  included 
informing  learners  of  objectives  and  motivating  them  to  continue  the  program.  The 
motivational  strategy  used  was  the  ARCS  (attention,  relevance,  confidence  and 
satisfaction)  Model  developed  by  Keller  (29).  To  gain  the  learner’s  attention  and  show 
the  relevancy  of  the  instruction,  statistics  on  life  span,  incidence  of  heart  disease  and 
cancer,  the  prevalence  of  obesity  and  its  health  risk,  and  nutrition’s  role  in  preserving 
quality  of  life  were  provided  (30).  Pictures,  sound,  and  animation  were  also  incorporated. 
Learners  were  informed  of  the  program’s  objectives  that  were  stated  in  a  problem-solving 
manner  to  appeal  to  adult  learning  characteristics.  For  example,  one  objective  was: 

“This  lesson  will  teach  you  skills  that  enable  you  to  look  at  your  diet  and  determine  if  it 
meets  the  recommended  requirements  of  the  Food  Guide  Pyramid.”  The  length  of  each 
module  was  also  given  in  the  introduction  so  learners  could  feel  more  in  control  of  how 
much  time  they  spent  completing  the  program.  Strategies  to  increase  learner  confidence 
and  satisfaction  were  also  incorporated  throughout  the  lesson. 

During  the  next  step  in  development  of  the  instructional  strategy,  all  content 
needed  to  perform  each  objective  was  written.  Examples,  non-examples,  one  to  two 
practice  questions  and  feedback  were  also  written. 

To  aid  in  the  transfer  of  learning,  a  hand-out  containing  the  food  groups  and  daily 
servings  was  provided,  examples  and  practice  questions  were  written  in  the  context  the 
learner  would  perform  the  skill,  and  memory  aids  were  developed.  One  memory  aid  used 
was  the  pneumonic  “BOB  (Brussels  sprouts.  Oranges,  Brewer’s  yeast)  knows  his  ABCs” 
(Asparagus,  Beans,  Collard  greens.  Spinach)  to  memorize  sources  of  folic  acid. 
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Phase  III:  Development 

The  development  phase  consisted  of  programming  the  instruction  into  the 
computer.  The  program  was  developed  by  the  first  author  using  HyperStudio^” 
(HyperStudio,  Version  3.1, 1997,  Roger  Wagner  Publishing  Inc.,  Santee,  CA)  an 
authoring  software  program.  Approximately  575  hours  were  needed  to  develop  the 
program.  Principles  of  effective  screen  design  and  computer-aided  design  were 
incorporated  into  the  program  (17,31,32).  The  program  was  developed  in  a  tutorial 
format.  Modules  were  introduced  by  stating  objectives  and  practical  application  of  the 
information.  Information  was  presented,  followed  by  examples  and  non-examples.  One 
to  two  practice  questions  for  each  objective  were  programmed  immediately  after  learners 
reviewed  the  information.  Appropriate  feedback  was  provided  based  on  the  learner’s 
individual  response.  When  learners  answered  correctly,  applause  was  sounded  and 
additional  information  was  provided  to  enrich  the  lesson.  For  incorrect  responses, 
corrective  feedback  was  provided.  Navigation  buttons  (forward,  back,  exit  and  main 
menu)  appeared  on  every  screen.  Branching  was  also  programmed  in  as  much  as  possible 
to  individualize  the  lesson.  The  first  draft  of  the  program  was  reviewed  by  two  nutrition 
professionals,  an  instructional  designer,  and  a  member  of  the  target  population.  Spelling 
errors,  navigational  errors,  content  clarity,  and  screen  design  suggestions  were  made  and 
the  program  was  revised  prior  to  evaluation  by  the  target  population. 

Phase  rV:  Formative  Evaluation 

Formative  evaluation,  the  collection  of  data  and  information  during  the 
development  of  instruction,  can  be  used  to  improve  the  effectiveness  of  the  instruction 


58 

(1).  The  formative  evaluation  consisted  of  two  phases:  a  one-to-one  evaluation  and  a 
small  group  evaluation.  In  both  phases,  subjects  completed  a  pre-test,  three  embedded 
tests,  two  post-tests,  and  an  attitude  questionnaire. 

One-to-one  evaluation,  used  to  identify  obvious  errors  in  the  program,  was 
conducted  with  three  members  of  the  target  populatioa  Subjects  included  a  male,  blue 
collar  worker  and  both  a  male  and  female  graduate  student  in  instructional  design, 
selected  to  add  design  insight.  All  reviewed  the  program  screen  by  screen  with  the 
designer.  Subjects  were  encouraged  to  give  frank,  honest  feedback  on  the  clarity,  screen 
design,  overall  flow,  terminology,  and  relevance  of  each  module.  Annotations  were  made 
on  all  feedback  provided.  Subjects  also  evaluated  the  clarity  of  directions  and  test  items 
on  the  assessment  instruments. 

The  phase  two,  small  group  evaluation,  used  to  determine  if  changes  made  during 
the  one-to-one  evaluation  were  effective  and  if  the  computer  program  could  run  in  the 
absence  of  the  designer,  was  conducted  with  fifteen  members  of  the  target  population. 
Twelve  subjects  were  a  convenience  sample  of  college  students  enrolled  in  education 
technology  courses  who  received  extra  credit  for  participation  while  the  other  three  were 
individuals  who  volunteered  from  the  community.  The  designer  acted  as  an  observer  and 
answered  questions  only  when  asked.  Subjects  were  randomly  interviewed  to  determine 
overall  likes  and  dislikes  and  to  have  an  opportunity  to  verbalize  lengthy  feedback. 
Proposed  solutions  were  made  to  problems  and  responses  were  recorded  to  facilitate 


revisions. 
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RESULTS  and  DISCUSSION 
One-to-One  Evaluation 

Responses  to  individual  interview  questions  and  comments  during  evaluation 
were  similar.  The  most  significant  concern  was  the  original  module  two,  “Calculating  a 
Serving  Size  of  an  Uncommon  Food.”  Subjects  did  not  feel  they  would  use  the  skill  and 
questioned  its  relevance.  Ratings  for  module  two  on  the  attitude  questionnaire  for 
attention,  relevance,  satisfaction  and  clarity  were  between  3  and  4,  the  lowest  ratings  of 
all  modules.  All  felt  the  program  was  too  long  (each  subject  took  four  hoius  to  complete 
the  entire  evaluation).  Subjects  had  trouble  retrieving  information  on  serving  sizes  taught 
in  module  one  and  three.  All  missed  at  least  two  out  of  four  serving  size  questions  on 
Embedded  Test  One.  Two  out  of  three  could  not  identify  serving  sizes  when  needed  on 
Embedded  Test  Three.  On  post-test  one,  all  subjects  had  difficulty  identifying  serving 
sizes  fi'om  the  given  menu  which  caused  them  to  miss  subsequent  questions  on  adding 
correct  portion  sizes  of  the  missing  servings. 

Two  subjects  felt  the  objectives  were  not  clearly  stated  in  the  beginning  of  the 
program  and  wanted  to  know  the  purpose  of  the  program  as  soon  as  possible.  All 
subjects  scored  the  three  entry  behavior  questions  on  the  pre-test  correctly  therefore, 
prerequisite  skills  were  assumed  correctly.  Their  overall  impression  of  the  program  was 
excellent  and  all  felt  the  information  was  very  useful. 

Based  on  these  results,  module  two  was  deleted.  The  sections  on  single  and 
multiple  servings  fi'om  module  one  and  three  were  combined  to  replace  module  two. 
Introductory  information  was  streamlined  and  objectives  stated  sooner  and  more  clearly. 
Navigation  buttons  were  placed  on  every  screen  and  links  between  screens  were  modified 
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to  increase  efficiency  of  flow  between  topics.  All  evaluation  instruments  were  revised  to 
match  new  modules. 

Small  Group  Evaluation 

Small  group  evaluation  tests  scores  and  the  percentage  of  subjects  mastering  each 
objective  are  summarized  in  Table  3.  Each  item  corresponded  to  an  objective  taught  in 
the  lesson.  Therefore,  when  an  item  was  missed  by  a  large  percentage  of  subjects,  the 
section  of  the  instruction  corresponding  to  that  objective,  was  reviewed  for  effectiveness 
if  the  test  item  was  not  poorly  written.  Based  on  pre-tests  scores,  all  entry  behaviors  were 
assessed  correctly  during  the  design  phase.  No  problems  were  noted  on  module  one 
based  on  Embedded  Test  One  scores. 

Subjects  had  difficulty  identifying  serving  sizes  on  Embedded  Tests  Two  and 
Three,  and  on  post-test  one.  In  module  two,  subjects  could  not  identify  the  serving  size 
of  rice,  baked  beans,  and  couscous.  The  question  was  reviewed  for  ambiguity  and  was 
clearly  stated,  therefore  it  was  not  deleted.  Instead,  the  section  of  the  program  covering 
this  information  was  reevaluated  for  weaknesses.  In  module  three,  subjects  had  difficulty 
identifying  the  number  of  missing  servings  from  the  bread  group  and  subsequently  had 
difficulty  choosing  the  food  in  the  correct  portion  size  to  correct  the  menu.  Both  skills 
required  the  subject  to  know  the  different  serving  sizes  for  the  bread  group.  On  post-test 
one,  subjects  had  difficulty  identifying  serving  sizes  for  each  food  group  firom  the  given 
menu.  This  caused  them  to  incorrectly  calculate  the  number  of  missing  servings  and  to 
incorrectly  identify  the  correct  portion  size  of  food  that  would  correct  the  menu.  Both 
skills  relied  heavily  on  identifying  serving  size,  a  topic  with  which  learners  had  obvious 
difficulty  based  on  Embedded  Tests  scores.  Correspondingly,  when  twelve  subjects  were 
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randomly  interviewed  after  reviewing  the  program,  they  stated  they  had  difficulty 
remembering  serving  sizes  and  wanted  back  buttons  on  practice  questions.  Ten  subjects 
wanted  serving  size  review  screens  in  module  three  so  that  they  could  successfully 
modify  the  menu.  Based  on  these  results  back  buttons  were  placed  on  all  practice 
questions  in  module  two.  Review  screens  were  placed  throughout  module  three. 

In  module  four,  ^''Vitamins  and  Minerals”  only  4  of  7  subjects  could  identify  food 
sources  of  iron  yet  6  out  of  7  subjects  could  incorporate  good  sources  of  iron  into  the 
menu.  When  the  test  item  on  identifying  food  sources  was  reviewed  for  clarity,  subjects 
may  have  had  difficulty  distinguishing  between  vegetable  and  animal  sources  of  iron, 
therefore  the  test  item  was  revised.  Only  2  of  6  subjects  and  3  of  8  subjects  could 
incorporate  food  sources  of  Vitamin  C  and  Beta-Carotene,  respectively,  into  the  menu. 
Upon  analysis  of  the  test  items  for  Vitamin  C  and  Beta-Carotene,  there  was  only  one 
correct  response  yet  subjects  selected  the  choice  stating  “Both  A  &  B”  which  included 
foods  that  would  decrease  the  level  of  these  vitamins  in  the  menu.  One  possible 
explanation  for  this  could  be  learner  fatigue.  Evaluations  took  two  hours  to  complete, 
post-test  two  was  the  last  set  of  questions  to  be  answered,  and  answers  required  critical 
examination  of  all  responses.  For  final  implementation,  the  program  is  not  intended  to  be 
completed  in  its  entirety  at  one  sitting,  however  subjects  were  made  to  review  all  sections 
during  the  formative  evaluation.  Because  low  scores  on  incorporating  food  sources  of 
vitamins  and  minerals  into  a  menu  could  possibly  be  explained  by  learner  fatigue  and 
faulty  test  items,  no  revisions  were  made  to  the  program  and  the  test  items  were  revised. 

Results  of  the  attitude  questionnaire  are  shown  in  Table  4.  All  items  were  scored 
favorably  by  learners.  Additionally,  subjects  were  least  satisfied  with  the  length  of  the 
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program  (mean  =  3.47).  Learner  fatigue  was  again  suspected.  Because  in  its  final  form, 
the  program  can  be  completed  one  module  or  section  at  a  time,  no  revisions  were  made  to 


the  length. 
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CONCLUSIONS 

Based  on  the  results  of  this  study  the  formative  evaluation  of  “Put  Nutrition  Into 
Practice”  was  successful.  Tests  results,  attitude  questionnaires,  and  interviews  with 
subjects,  revealed  similar  problems  therefore  making  the  errors  in  program  design 
obvious.  Formative  evaluation  of  any  educational  material  is  essential  to  make  the 
product  usable  and  well-received  by  the  target  population,  however,  formative  evaluation 
alone  is  not  enough.  To  determine  effectiveness,  “Put  Nutrition  Into  Practice”  should 
undergo  summative  evaluation  once  it  is  in  it’s  final  form. 

Nutrition  education  computer  programs  should  have  a  narrowly  defined  target 
population  and  topics  selected  for  inclusion  should  be  decided  upon  by  the  target 
population  and  fill  a  “need”  within  that  population.  Additionally,  a  nutrition  education 
computer  program’s  design  should  be  based  on  effective  design  principles  (17,32).  The 
Dick  and  Carey  model  of  instructional  design  is  an  effective  way  to  design  computer- 
based  nutrition  education  to  help  the  public  achieve  Healthy  People  2010  nutrition 
objectives  and  future  health  objectives. 

This  study  is  unique  in  that  it  merges  principles  of  adult  education  with  effective 
instructional  design  strategies  and  effective  nutrition  education  strategies,  to  create  a 
well-designed  computer  program.  The  Dick  and  Carey  model  of  instructional  design  is 
suggested  as  a  new  approach  to  nutrition  education  that  comes  from  instructional 
designers  who  are  experts  in  education.  Nutrition  educators  are  encouraged  to  employ 
systematic  models  of  instructional  design,  which  nicely  merge  with  nutrition  education 
strategic  frameworks  to  produce  effective  nutrition  education. 


Table  1  Summary  of  focus  groups,  e-mail  survey  and  dietitian  survey  questions 


Focus  Group  and  E-mail  Survey: 

1 .  Have  you  heard  of  the  Food  Guide  Pyramid  and  what  do  you  know  about  it? 

2.  What  nutrition  topics  are  you  most  interested  in? 

3 .  What  motivates  you  to  learn  about  nutrition? 

4.  How  comfortable  are  you  with  using  a  computer  for  education? 

5.  How  long  should  a  computer  program  about  nutrition  be? 

6.  What  features  would  help  you  translate  the  information  from  the  computer  program  to 
your  daily  lives? 

Dietitian  Survey: 

1 .  What  topics  are  typically  covered  in  a  counseling  session  on  basic  nutrition? 

2.  What  basic  nutrition  topics  would  you  like  included  in  a  nutrition  education 
computer  program? 

3.  How  long  should  the  program  be? 

4.  Do  you  see  a  need  for  a  computer  program  that  provides  basic  nutrition  information? 
If  no,  why? 


Table  2  Summary  results  from  focus  groups  and  e-mail  survey 

Focus  Groups 

E-mail  Survey 

Prior  Knowledge 
of  the  Pyramid 

10/16  kneAv  of  the 
pyramid 

15/16  could  not  name 
the  food  groups  or  daily 
servings 

21/25  knew  of  the 
pyramid 

4/25  knew  “Foods 
higher  up  should  be 
eaten  less  often” 

12/25  knew  it 
represented  food 
groups  and  daily 
servings  but  could 
not  name  them. 

Nutrition  Topics 
of  Interest 

Vitamins  and  Minerals 
Long-term 

consequences  of  daily 
eating  habits 

Meal  preparation 
Healthy  fast  foods 

Fad  diet  claims 

Meal  Planning 

Foods  link  to  disease 

Nutrient 

requirements 

Motivators 

“Attention  getting 
statements” 

Living  a  long  life 

Weight  maintenance 
Personal  appearance 
Anecdotal  evidence  of 

success 

Humor 

Preventing  disease 
Staying  healthy 
Maintaining  or 
losing  weight 

Fallacies  on  diet  in 
the  literature 

Children 

Getting  fit 

Comfort  level 
using  a  computer 
and  length  of 
program 

All  felt  comfortable 
15-20  minutes  per 
module 

All  felt  comfortable 
15-30  minutes  at  a 
time 

Learning 
transfer  topics 

References  to  obtain 
additional  information 
Goal  setting 

Family  support 

Keeping  food  records 

“Plain  English” 
Printable  worksheets 
Meal  planning 

Menus 
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Table  3  Percentage  of  subjects  correctly  answering  test  items  and  mastering  each 
objective^ _ 


Test  % 

Coverage  Objective  Test  Items’*  Mastering 

and  Type _ _ _ Objective 


Pretest 

Entry 

Behavior 

s 

1  2  3  4  5  6 

93 

100 

93 

93 

Embedded 

Test 

Module  1: 

Food 

Groups 

Name 

Each 

Food 

Group 

87 

93 

93 

80 

80 

Name 
Foods  In 
Each 
Groups 

67 

73 

87 

80 

67 

Embedded 

Test 

Module  2: 

Serving 

Sizes 

Identify 

Single 

Servings 

93 

27 

93 

27 

Visually 
Identify 
Single 
Servings 
of Foods 

93 

93 

93 

Visually 
Identify 
Multiple 
Servings 
of Foods 

73 

67 

67 

Embedded 

Test 

Module  3: 
Modify  a 
Menu 

Calculate 

Multiple 

Servings 

100 

93 

93 

Identify 

Daily 

Servings 

93 

73 

73 

Posttest  1 
for 


Select 

Food 

from 

Missing 

Group 

87 

Add 

Food  in 
Correct 
Portion 

80 

Calculate 

Missing 

Serving 

67 

Add 

Food  to 
Correct 
Menu 

67 

Identify 

Serving 

Sizes 

53 

Identify 

Missing 

Servings 

67 

Add 

Missing 

Servings 

in 

Correct 

Portion 

67 

Identify 

Food 

n=5 

Sources 

80 

Modify 

Menu 

with 

Food 

Sources 

60 

^  n==15  subjects 

^  Empty  cells  are  present  if  less  than  six  test  items  were  asked  per  objective.  Test  question  number 
corresponds  to  the  vitamin  and/or  mineral  reviewed  on  Post-Test  Two:  1 -Folic  Acid,  2-Vitamin  C,  3- 
Beta-Carotene,  4-Calcium,  5-Iron,  6- Vitamin  E 

^  Subjects  were  required  to  review  a  minimum  of  only  one  vitamin  or  mineral,  therefore  subject  number 
varied. 
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Table  4  Participants  attitudes  toward  “Put  Nutrition  Into  Practice”* 

Program 

Component 

Attention'’ 

Relevance' 

Confidence** 

Satisfaction' 

Clarity* 

Module  1 
Familiarization 
with  Food  Groups 

4.47 

4.47 

4.53 

4.53 

4.60 

Module  2 

Serving  Sizes 

4.00 

4.27 

3.80 

4.13 

4.07 

Module  3 
Modifying  a 

Menu 

3.87 

4.47 

3.93 

4.07 

3.89 

Module  4 

Vitamins  and 
Minerals 

3.80 

4.27 

3.67 

4.27 

4.40 

Practice 

Questions® 

4.47 

4.53 

N/A 

N/A 

4.53 

“  n  =  15  subjects,  mean  scores  shown 


1  2 
Not  Attentive 
Not  Relevant 
No  Confidence 
Not  Satisfied 
Not  Clear 


Very  Attentive 
Very  Relevant 
Very  Confident 
Very  Satisfied 
Very  Clear 


®  Confidence  and  satisfaction  were  not  assessed  for  practice  questions 


Figure  1  Instructional  Analysis  for  the  Instructional  Goal* : 
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Each  step  represents  what  the  learner  would  be  doing  if  he/she  were  successfully  performing  the  instructional  goal. 
Steps  1,2  &  4  were  programmed  into  “Put  Nutrition  Into  Practice” 

Connecting  point  for  the  complete  breakdown  of  step  in  instmctional  goal 


Figure  2  Subskills  Analysis  for  Step  2  of  the  Instructional  Goal 

Given  a  food  record,  determine  what  food  group/s  is/are  deficient  and  correct  them. 

Step  2® 


Denotes  steps  that  must  be  learned  in  order  to  perform  step  2.5 1 . 
'  Skills  learner  is  assumed  to  posses  prior  to  lesson. 

Deleted  after  one-to-one  evaluation 
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APPENDIX  A 

INFORMED  CONSENT  FORM 


Formative  Research  on  the  Design  and  Development  of  Nutrition  Education 

Software 

I  have  been  asked  to  participate  as  a  subject  in  a  study  to  evaluate  nutrition  education 
software  in  it’s  developmental  stage.  If  I  choose  to  participate,  I  will  complete  a 
questionnaire  that  provides  the  researcher  with  my  name,  phone  number,  age,  sex,  marital 
status  and  education  level.  I  may  be  included  in  the  focus  group  before  the  evaluation 
stage  begins  or  I  may  be  in  any  one  of  the  two  stages  of  the  evaluation  phase  of  the 
research.  If  I  am  involved  in  the  evaluation  stages  of  the  project;  I  will  complete  a  pre¬ 
test,  complete  the  computer  lesson  and  answer  questions  about  its  content  and  format, 
then  I  will  complete  a  post-test  and  an  attitude  survey.  The  time  required  will  be 
approximately  2  hours. 

There  are  no  reasonably  foreseeable  physical  discomforts  or  risks  associated  with  the 
focus  group  or  the  evaluation  activity.  The  benefits  to  me  are  that  I  will  be  taught  the 
basic  nutrition  principles  of  the  Food  Guide  Pyramid,  and  be  given  opportunities  to 
practice  the  skills  I  leam.  The  benefit  to  others  will  be  more  effective  nutrition  education 
in  the  future. 

If  I  have  further  questions  or  problems  after  completing  the  computerized  nutrition  lesson 
I  will  have  an  opportimity  to  ask  those  questions  of  the  researcher. 

The  personal  data  on  me  will  be  summarized  and  reported  only  in  group  format.  The 
answers  to  pre  and  post  tests  and  attitude  surveys  will  be  reported  individually  in  chart 
format  and  the  name  will  be  replaced  with  a  number  designation  to  ensure  confidentiality. 
Information  that  is  gathered  about  me  will  not  be  reported  to  anyone  outside  the  research 
project  in  a  manner  that  personally  identifies  me. 

I  may  ask  questions  about  this  project  to  Capt.  Deborah  J  Carlton,  RD,  CDE  (770-396- 
0006)  or  of  her  advisor.  Dr.  Jana  Kicklighter  of  the  Nutrition  and  Laboratory 
Technologies  Department  at  Georgia  State  University,  404-651-1 106.  The  GSU 
Research  Office  (room  G-76  Alumni  Hall)  can  provide  me  with  general  information 
about  the  rights  of  human  subjects  in  research. 

I  understand  that  I  may  refuse  to  participate  in  this  study,  and  if  I  do  choose  to  participate 
I  may  stop  at  any  time.  If  I  refuse  to  participate  or  decide  to  stop,  I  will  not  be  penalized 
and  will  not  lose  any  benefits  to  which  I  am  entitled. 
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I  have  read  and  understand  the  above,  and  I  agree  to  participate  as  a  subject  in  this  study. 


Printed  Name  Subject  Signature  Date 


Printed  Name 


Witness  Signature 


Date 


APPENDIX  B 

POPULATION  STATISTICS  WORKSHEET 

Formative  Research  on  the  Design  and  Development 
of  Nutrition  Education  Software 


Please  be  reminded  that  data  on  this  sheet  will  be  confidential  by  the  researcher.  The  data  is  gathered  to 
determine  if  the  study  population  statistics  match  the  target  population. 


Name: _ 

Age: _ 

Check  One:  Male _ ^Female _ 

Home  Phone: _ ^Work  Phone: _ 

Marital  Status:  Married _ ^Divorced _ Single _ Other: 


Highest  Education  Level  Attained: 

High  School  Diploma _ 

Bachelor’s  Degree _ 

Masters  Degree _ 

Doctorate  Degree _ 

M.D. _ 

Other: _ _ _ _ 

Please  rate  your  level  of  competency  in  computer  use  on  a  scale  of  1  to  5. 

no  training  ^  highly  skilled 

1  2  3  4  5 

Have  you  had  formal  nutrition  education  from  a  dietiti^? 

Yes _  For  what? _ _ _ _ _ 

No  ' 

Were  you  taught  basic  nutrition  principles  in  any  part  of  your  schooling? 

Yes _ How  long  ago? _ 

No _ 
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APPENDIX  C 

FOCUS  GROUP  AND  E-MAIL  QUESTIONNAIRE 
Questions  may  be  added  based  on  the  responses  during  the  focus  group  session. 

1 .  How  many  of  you  have  heard  of  the  Food  Guide  Pyramid?  For  those  of  you  who 
have  heard  of  it,  tell  me  what  you  already  know  about  the  Food  Guide  Pyramid. 

2.  If  a  computer  program  were  to  be  developed  to  teach  you  about  basic  nutrition,  such 
as  the  Food  Guide  Pyramid,  what  specific  types  of  information  would  you  be  interested  in 

learning  about?  For  example,  label  reading,  knowing  which  foods  belong  to  which 
food  groups,  weight  loss,  meal  planning . 

3.  If  exercise  were  to  be  included  as  a  topic  in  the  computer  program,  what  would  you 
like  to  know? 

4.  How  comfortable  do  you  feel  using  a  computer  for  educational  lessons? 

5.  Tell  me  what  would  help  you  use  the  nutrition  information  from  the  computer 
program  in  your  everyday  life?  What  are  some  features  that  you  think  should  be 
included? 

6.  How  long  do  you  think  a  lesson  on  basic  nutrition  should  last? 

7.  In  what  setting  would  you  like  to  have  access  to  and  use  the  computer  program? 
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5.  Would  you  use/recommend  a  computer  program  to  clients  requesting  this 
information? 

Yes _ 

No _ Why  not? _ _ _ 

Not  Sure _ 

6.  Are  you  currently  using  a  computer  software  program  to  teach  basic  nutrition 
principles  to  clients?  If  yes,  which  one?  If  no,  go  to  question  9. 

_ ^Yes  Titled:  _ _ 

_ ^No  Go  to  question  9. 

7.  What  do  you  like  about  the  program? 

_ Graphics 

_ Content 

_ ^Practice  questions 

_ ^Nutrient  databases  for  diet  recall  are  complete 

_ ^Exercise  session  time  increments  are  appropriate  for  my  audience 

OTHER: _ _ _ 


8.  What  would  you  like  to  see  improved/added? 

_ Graphics 

_ Content 

_ ^Practice  questions 

Nutrient  databases  for  diet  recall 

_ ^Exercise  session  time  increments 

OTHER; _ _ 


9.  Do  you  see  a  need  for  a  computer  program  that  provides  basic  nutrition  information 
(teaches  the  principles  of  the  Food  Guide  Pyramid)  ?  If  no,  please  state  why  and  tell  me 
what  you  do  see  a  need  for. 

Yes _ 

No _ 

Why  not? _ _ _ _ _ 

What  do  you  see  a  need  for? _ _ _ _ _ _ 


10.  If  a  computer  program  was  to  be  developed  that  taught  basic  nutrition  principles, 
what  would  you  like  to  see  included?  Please  rank  the  topics  below  (1-8)  from  most 
wanted  to  least  wanted.  1  being  the  most  needed/wanted  to  8  being  the  least  wanted 

_ Identify  the  food  groups  in  the  Food  Guide  Pyramid 

_ ^Identify  appropriate  serving  sizes  for  each  food  group 

_ ^Practice  questions  that  address  correct  foods  in  a  food  group 
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Practice  questions  that  address  correct  serving  sizes 

_ ^Practice  questions  that  require  the  client  to  complete  a  day’s  menu  using  the  Food 

Guide  Pyramid 

_ ^Calculation  of  ideal  body  weight 

_ ^Identify  the  correct  number  of  servings  from  each  food  group  to  meet  given  calorie 

level 

_ ^How  to  read  food  labels 

OTHER: _ _ _ _ 

1 1 .  Would  you  want  this  program  to  be  all  inclusive,  meaning  that  it  will  replace  your 
basic  diet  instruction  and  patients  would  be  instructed  to  see  you  if  they  have  further 
questions;  or  would  you  like  the  program  to  be  used  as  an  adjunct  to  your  instruction, 
meaning  that  the  program  would  provide  an  opportunity  for  clients  to  practice  skills  that 
you  have  already  taught  them?  Please  check  one. 

All  Inclusive _  Adjimct _ 

12.  Would  you  like  a  workbook  to; 

A.  Explain  how  to  run  the  program  for  clients  to  refer  to  when  needed?  Yes _ ^No _ 

B.  Be  used  as  a  reference  for  clients  to  take  with  them  after  completing  the  computer 
lesson?  Yes  No 


13.  In  what  capacity  would  you  use  this  program? 

_ ^First  introduction  to  nutrition  before  they  see  me 

_ ^As  an  adjunct  to  my  counseling 

_ To  replace  basic  nutrition  classes  currently  being  taught 

OTHER: _ _ _ 


14.  How  long  should  the  lesson  be?  Please  check  one. 
30  minutes _ ^45  minutes  60  minutes_ 

Any  Other  Comments  You  Would  Like  to  Address: _ 


Thank-you  once  again  for  your  time  and  input.  Your  comments  are  very  important  to  the  completion  of 
this  project.  If  you  have  any  questions,  please  call  me  at  770-396-0006,  or  e-mail  me  at 
CaptDebi@aol.com 

Please  return  survey  in  the  self-addressed  envelope  by  June  24, 1998  to: 

Captain  Deborah  J  Carlton 
5008  Wingate  Way 
Dunwoody,  Ga  30350 


APPENDIX  E 

PERFORMANCE  OBJECTIVES  WITH  PARALLEL  TEST  ITMES 


Subordinate 

Skills 

Performance  Objectives 

Parallel  Test  Item 

2.111  Name  the  food 
groups  in  the  pyramid 

Given  a  picture  of  a  pyramid 
divided  into  groups,  the 
learner  will  identify  all  6  food 
groups  with  100%  accuracy 

1.  What  is  the  name  of  the  highlighted  food  group 
on  the  pyramid? 

2.112  Identify  5  foods 
found  in  each  food 
group 

Given  a  list  of  foods,  the 
learner  will  identify  5  foods 
found  in  a  specified  food 
group  with  90%  accuracy. 

Identify  the  5  foods  from  this  list  found  in  the  meat 
group. 

1.  Eggs  6.  Fish 

2.  Milk  7.  Cream  Cheese 

3.  Cheese  8.  Bagels 

4.  Ham  9.  Sausage 

5.  Oysters  10.  Hot  Dogs 

2.113  Identify  one 
serving  of  common 
foods  found  in  each 
food  group. 

Given  5  common  foods  found 
in  a  food  group,  the  learner 
will  identify  the  serving  size 
for  each  food  as  defined  by 
USDA  Pyramid  guidelines 

1 .  The  serving  size  for  any  cooked  vegetable  is _ . 

a.  Ic.  b.  l/4c.  c.  l/2c.  d.  l/3c. 

2.  The  serving  size  for  rice,  baked  beans  and 
couscous  is: 

a.  Ic.  b.  l/4c.  c.  l/2c.  d.  l/3c. 

3.  The  serving  size  for  any  cooked  meat  is: 
a.  2oz.  b.  loz.  c.  3oz.  d.  4oz. 

4.  The  serving  size  for  pasta,  mashed  potatoes, 
com  and  peas  is: 

a.  Ic.  b.  l/4c.  c.  l/2c,  d.  l/3c. 

2.11  Recognize  one 
portion  size  of 
common  foods  foimd 
in  each  food  group. 

Given  3  pictures  of  the  same 
food,  the  learner  will  identify 
which  picture  represents  1 
portion  size  of  that  food  with 
100%  accuracy. 

1.  Identify  which  picture,  from  the  3  below, 
represents  1  portion  size  of  cereal. 

2.  Identify  which  picture,  from  the  3  below, 
represent  3oz.  of  cooked  ham. 

2.121  Identify  the 
calorie  level  for  each 
food  group. 

Given  the  food  group  name, 

I  the  learner  will  identify  the 
calories  found  in  1  portion  of 
food  as  specified  in  the 
exchange  system. 

From  the  choices  below,  select  the  correct  letter  that 

answers  the  following  questions.  There  is  only  1 

letter  for  each  question. 

1.  How  many  calories  are  in  the  fat  group? 

2.  How  many  calories  are  found  in  the  lean-meat 
group? 

3.  How  many  calories  are  found  in  the  bread 
group? 

4.  How  many  calories  are  found  in  the  fruit  group? 

5.  How  many  calories  are  foimd  in  the  vegetable 
group? 

a.  80  b.  55  c.  45  d.  25  e.  60 
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2.122  Divide  calories 
in  1  portion  of  the  food 
by  the  calories  in  its’ 
food  group  to  get  the 
number  of  food  group 
servings 


2.123  Divide  serving 
size  on  the  label  by  the 
number  of  food  group 
servings  to  get  the 
amount  equivalent  to  1 
food  group  serving.. 


2.12  Calculate  one 
serving  of  an 
uncommon  food. 


Given  a  food  label,  the  learner 
will  divide  the  calories  in  1 
portion  of  the  food  by  the 
calories  in  its’  food  group  to 
get  the  number  of  food  group 
servings  roxmd  answer  to 
nearest  Vi  serving. 


LABEL 

Masada  Everything  Bagel 
Serving  Size:  1  Bagel 
Calories:  240 

Calculate  the  number  of  servings  of  the  appropriate 
food  group  this  bagel  is  equal  to,  to  the  nearest  V2 
serving. 

a.  1  b.  2  c.  3  d.  4 


Given  a  food  label  and  the 
number  of  food  group 
servings  in  1  portion,  divide 
the  serving  size  on  the  label  by 
the  number  of  food  group 
servings  to  equal  1  food  group 
serving,  answer  must  be  given 


Label 

Kellog’s  Product  19 
Serving  Size:  1  cup 
Calories:  100 

There  are  1  14  bread  servings  in  1  c.  of  Product  19. 
How  much  of  Product  19  equals  1  bread  serving? 
a.  l/2c.  b.  1  l/4c.  c.  3/4c.  d.  2c 


to  the  nearest  l/4c. _ 

Given  a  food  label,  the  learner 
will  calculate  the  portion  size 
of  one  food  group  serving,  the 
answer  must  be  to  the  nearest 
l/4c. 


Label 

Quaker  Instant  Oatmeal  Maple  and  Brown 
Sugar 

Serving  Size:  1  pouch 
Calories:  170 


1.  This  food  belongs  to  which  food  group? 
a.  bread  b.  vegetable  c.  fruit  d.  fat 

2.  What  portion  of  this  pouch  of  oatmeal  equals  1 
serving 

a.  1  b.  Vi  c.  *74  d.  y4 


2.13  Recognize 
multiples  of  serving 
sizes 


Given  a  picture,  the  learner 
will  identify  how  many 
servings  the  food  equals  to  the 
nearest  whole  number. 


1.  PICTURE: 

Beef  - 

How  many  servings  of  the  meat  group  is  this  picture 


of  steak? 

a.  1  b.  3  c.  4  d.  8 


2.  PICTURE: 


Glass  of  Orange  Juice 


How  many  servings  of  the  fruit  group  is  this  picture 
of  juice? 

a.  1  b.  1  72  c.  2  d.  3 


2. 1  Calculate  multiple  Given  a  food  and  its  quantity 
servings  of  a  food.  for  one  portion,  calculate 

multiple  servings  of  that  food. 


If  a  serving  of  rice  equals  l/3c.  then  how  many 
servings  is  Ic.  of  rice  equal  to? 
a.  3  b.  2  c.  2  ‘/z  d.  72 


2,2  Identify  the 
recommended  number 
of  daily  servings  from 
each  food  group. 

Given  the  name  of  a  food 
group,  the  learner  will  identify 
the  recommended  number  of 
daily  servings  from  each  food 
group,  answer  should 
correspond  to  the  USDA 
guidelines  and  be  stated  as  a 
range  where  appropriate. 

1.  How  many  servings  should  you  consume  from 
the  milk  group  every  day? 

a.  2-3  b.  3  c  4  d.  none 

2.  How  many  servings  from  the  fruit  group  should 
you  consume  everyday? 

a.  2-4  b.  1  c.  5  d.  3-5 

2.3  Select  a  food  from 

Given  a  food  group,  the 

1.  MENU 

the  missing  food 

learner  will  select  a  food  from 

Turkey  Sandwich 

group. 

the  missing  food  group  with 

1c.  carrots 

100%  accuracy. 

2Tbsp.  Low-fat  salad  dressing 

1  Diet  Coke 

This  person  didn’t  consume  anything  from  the  fruit 
group.  What  could  he  add  to  his  menu  that  is  from 
the  fruit  group. 

a.  orange  b.  loz.  potato  chips 

b.  ITbsp.  pecans  d.  loz.  cheese 

2.4  Assign  a  serving 

Given  a  missing  food  and  the 

1.  Joey  forgot  to  eat  vegetables  all  day.  He  loves 

size  which  equals  the 

food  which  will  be  added,  the 

steamed  broccoli  and  wants  to  get  all  his 

recommended  daily 

learner  will  assign  a  serving 

vegetable  servings  at  dinner.  How  much 

servings. 

size  to  that  food  which  will 

broccoli  will  he  need  to  eat  to  get  all  his 

equal  the  recommended  daily 

recommended  daily  servings  of  vegetables? 

servings  of  that  food  group, 

1  answer  must  be  accuarate  to 
the  nearest  cup. 

a.  1  l/2c.  b.  2c  c.  l/2c.  d.  3c 

2.51  Calculate  missing 

Given  a  menu  and  the  daily 

1.  MENU 

servings. 

goal  for  the  deficient  food 

Breakfast 

group,  the  learner  will 

1c.  orange  juice 

calculate  the  number  of 

2c.  oatmeal 

missing  servings  with  100% 
accuracy. 

1/2c.  skim  milk 

Lunch 

2  slices  bread 

3oz.  roast  beef 

1c.  carrots 

1  apple 

Dinner 

3oz.  chicken 

1/2c.  raspberries 

1c.  cooked  broccoli 

This  menu  does  not  have  enough  breads,  how  many 
servings  are  missing  (the  daily  goal  is  1 1)? 
a.  4  b.  5  c.  6  d,  2 


2.5  Add  an  appropriate  I  Given  a  menu  and  a  deficient 


food  in  the  correct 
portion  size  to  meet 
the  recommended 
daily  servings. 


2.  Determine  what 
food  group/s  is 
deficient  in  a  food 
record  and  correct  it. 


food  group,  the  learner  will 
add  an  approprite  food  in  the 
correct  portion  size  to  meet 
the  recommended  daily 
servings  for  that  food  group 
with  100%  accuracy. 


Given  a  food  record,  the 
learner  will  determine  what 
food  group/s  is  deficient  and 
correct  it. 


1 .  Using  the  menu  above  (2.51)  select  the  food 
below  that  would  allow  this  person  to  meet  all  of 
his  starch^^ead  requirements  for  the  day. 
(remember  goal  was  1 1  servings) 

a.  2c  rice 

b.  2  l/2c.  mashed  potatoes 

c.  3  slices  of  bread 

d.  Ic.  peas 


1.  Breakfast 
1  l/2c.  oatmeal 
l/2c.  milk 
ITbsp.  margarine 
1  banana 


Lunch 

turkey  sandwich 
fat-free  mayonnaise 
lettuce/tomato 
3oz.  turkey  meat 
1  l/2oz.  pretzels 
1  Diet  coke 

Dmner 

3oz.  meatloaf 

l/2c.  mashed  potatoes 

Ic.  broccoli 

ITbsp.  margarine 

1  dinner  roll 

l/2c.  canned  peaches 

What  needs  to  be  added  to  this  menu  to  allow  Brian 
to  meet  the  recommended  daily  servings  of  all  6 
food  groups? 

a.  l/2c.  orange  juice  &  1  l/2c.  milk 

b.  l/2c  orange  juice  &  Ic.  raw  carrots 

c.  1  l/2c.  milk  &  Ic.  raw  carrots 

d.  Ic  orange  juice  &  l/2c  cooked  carrots. 


INCORPORATING  GOOD  SOURCES  OF  VITAMINS  AND  MINERALS  INTO  A 

FOOD  RECORD 


4.2  Identify  5  foods 
that  are  good  sources 
of  the  vitamin  and/or 
mineral  that  you  found 
to  be  of  personal 


Given  a  list  of  foods,  the 
learner  wiU  identify  5  foods 
that  are  good  sources  of  the 
vitamin  and/or  mineral  of 
personal  concern  with  100% 
accuracy. 


Please  select  the  choice  below  which  includes  foods 
high  in  folic  acid. 

a.  bread,  margarine,  olive  oil,  mayonnaise, 
oranges 

b.  spinach,  Brussels  sprouts,  asparagus,  orange 
juice,  cantaloupe 

c.  steak,  peas,  potatoes,  com,  mango 

d.  fortified  breakfast  cereals,  spinach,  mango, 

orange,  peanuts _ 
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4.  Incorporate  2  good 
sources  of  any  vitamin 
or  mineral  that  is  a 
concern  given  age, 
gender,  family  history 
of  illness  or  current 
medical  condition  such 
as  pregnancy,  into  a  24 
hour  food  record. 


Given  a  food  record,  the 
learner  will  incorporate  2 
good  sources  of  any  vitamin 
or  mineral  that  is  a  concern 
given  age,  gender,  family 
history  of  illness  or  current 
medical  condition  such  as 
pregnancy,  into  a  24  hour  food 
record.  Foods  that  are 
replaced  should  be  from  the 
same  food  group. 


Breakfast 
2  waffles 
2Tbsp.  butter 
l/2c.  orange  juice 

Lunch 

3oz.  bologna 
2  slices  bread 
ITbsp.  mayonnaise 
Ic,  green  olives 
1  apple 


Dinner 

3oz.  pork  sausage 
Ic.  mashed  potatoes 
Ic.  steamed  carrots 
Ic.  whole  milk 


Mrs.  Rodgers  just  found  out  she  has  elevated 
homocysteine  levels  in  her  blood.  Her  dietitian 
advised  her  to  eat  foods  high  in  folic  acid  to  bring 
the  homocysteine  levels  down  to  help  prevent  heart 
disease.  She  wrote  down  everything  she  ate  and  is 
ready  to  replace  2  foods  on  the  menu  to  increase  her 
intake  of  folic  acid. 


Using  the  food  record  above,  select  the  choice  that 

will  increase  her  folic  acid  intake.  Remember,  any 

food  replaced  should  be  from  the  same  food  group. 

a.  Replace  waffles  at  breakfast  with  fortified 
breakfast  cereal  and  replace  green  olives  at 
lunch  with  spinach  salad  and  sunflower  seeds 

b.  Replace  bologna  and  bread  at  lunch  with  black 
beans  and  yellow  rice  and  replace  the  apple  at 
lunch  with  cantaloupe 

c.  Replace  the  mashed  potatoes  at  dinner  with 
great  northern  beans  and  replace  the  carrots  with 
Brussels  sprouts 

d.  A  and  B 

e.  All  of  the  above 


APPENDIX  F 

INFORMATION  PRESENTATION  AND  STUDENT  PARTICIPATION 
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FATS/OILS  AND  SWEETS: 
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This  group  contains  foods  that  have  15gm  of  carbohydrate  What  group  would  dried  apricots,  raisins,  dried  bananas  and  dates  fall  under? 

and  no  protein  and  no  fat.  Here  are  some  examples:  juices  of 

all  kinds,  oranges,  apples,  kiwi,  mango,  papaya,  banana.  Feedback: 

strawberries.  These  too,  belong  to  the  fruit  group.  They  are  very  concentrated  in  calories 

because  they  are  dried. 
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The  serving  size  on  the  food  label  does  not  always  correlate  Practice: 

with  the  serving  size  in  the  food  guide  pyramid.  However,  Label:  Whole  Cashews  Serving  Size:  l/4c.  Calories:  210 


learner  will  divide  once  you  know  the  calorie  level  of  each  food  group  in  the 
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portion  of  the  belongs  to,  you  can  calculate  the  number  of  pyramid  seryings  serving  of  cashews  as  stated  on  the  food  label? 

food  by  the  from  1  serving  size  as  stated  on  the  food  label.  To  do  this 
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group  serving;  Calories:  210  So,  6  divided  by  1  ‘/i  =  4. 

answer  must  be  So,  4  cookies  is  1  serving  from  the  pyramid  and  has  about  80  calories, 

given  to  the  This  portion  of  cashews  (4  Tbsp.  Or  l/4c)  contains  4  food  Remember,  vanilla  wafers  are  from  the  bread  group, 

nearest  l/4c.  group  servings.  So,  to  figure  out  what  portion  of  the  cashews 

_ will  equal  1  serving  of  cashews  in  the  food  guide  pyramid. 


you  have  to  divide  the  serving  size  on  the  label  (4  Tbsp.)  by 
the  number  of  food  group  servings  (4). 

4  Tbsp.  /  4  servings  =  1  Tbsp.  of  cashews  equals  1  serving  of 
fats  in  the  pyramid. 
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The  crackers  belong  to  the  bread  group,  which  contains  80 
calories  in  1  serving.  130  calories  worth  of  crackers  contain 


1.6  pyramid  servings  or  1  Vi  pyramid  servings.  So, 
crackers  divided  by  1.5  servings  =  6  crackers. 
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for  one  portion,  usually  more  than  1  pyramid  portion.  When  you  calculate  of  a  deck  of  cards) 

calculate  multiple  multiple  servings  you  know  how  many  servings  from  that  a.  1  b.  2  c,3  d.  4 

servings  of  that  food  group  you  have  eaten,  and  how  much  more  you  need  to  Feedback: 

food.  eat  to  get  enough  or  if  you  have  eaten  too  much  of  that  food  There  are  3  servings  of  meat  in  3oz.  because  1  serving  equals  1  oz. 

group  and  your  diet  isn’t  balanced. 


Example: 

If  1  portion  of  oatmeal  equals  l/2c.  then  how  many  servings  is 
Ic.  of  oatmeal  equal  to? 
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We  need  a  combmation  ot  at  least  5  truits  and  vegetables. 

You  need  2-4  servings  of  fruit,  the  lower  number  if  you  are 
small  and  petite  and  the  larger  number  if  you  are  large  or  very 
active. 


You  need  3-5  vegetables.  If  you  overeat  any  food  group,  this 
is  the  one.  Remember  this  group  contains  only  25  calories  in 
1  servings  and  is  packed  with  vitamins  and  minerals  like 
calcium,  iron,  beta-carotene  and  folic  acid. 
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from  the  missing  For  example:  glass  of  orange  juice 

food  group  with  Brian  reviewed  his  menu  and  he  realized  he  was  not  eating 

100%  accuracy.  vegetables.  He  had  to  select  a  food  found  in  the  vegetable  The  food  groups  missing  are  the  meat  and  vegetable  group.  What  could  Jeff 

group  that  he  liked  and  could  easily  add  to  his  daily  diet.  add  to  this  menu  to  get  some  meat  and  vegetables? 

What  would  be  a  good  choice?  a.  soy  sausage _ 


a.  carrots  b.  oranges  c.  bagels  d.  ham  b.  vegetable  juice 

c.  egg  scrambled  with  green  peppers,  mushrooms  and  onions 
Feedback:  d.  All  of  the  above 

The  carrots  are  the  best  choice  because  they  are  in  the 
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daily  servings.  Let’s  say  he  loves  steamed  broccoli.  So,  he 
decides  to  get  2  servings  of  vegetables  as  carrots  and  2 
servings  of  vegetables  as  steamed  broccoli.  This  would  give 
him  4  servings  of  vegetables  for  the  day  which  is  what  is 
recommended.  Remember  the  serving  size  for  raw  carrots  is 


Ic.,  so  2  servings  of  carrots  equals  2c.  TTie  serving  size  for 
steamed  broccoli  is  l/2c.  so,  2  servings  of  broccoli  is  Vz  c.  + 

Vi  c.  =  Ic  of  steamed  broccoli.  So,  by  the  end  of  the  day  Brian 
has  eaten  2  servings  of  vegetables  as  carrots,  and  2  servings  as 
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One  food  Johnny  hasn’t  eaten  enough  of  is  meat.  How  many  Well,  Johnny  gets  Vi  milk  serving  at  breakfast  and  then  1  serving  of  the  milk 

meat  servings  are  missing  if  the  daily  goal  for  him  is  7  group  as  yogurt  at  dinner.  If  his  daily  goal  is  3,  then  he  is  missing  1  Vi  servings 

servings  of  meat  per  day?  from  the  milk  group. 


The  answer  is  5  servings.  Remember,  th 
is  5-7oz.  per  day  or  the  equivalent.  He  o 
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Crystal’s  food  record.  Crystal  is  a  petite,  small  woman,  so  she  5.  How  many  servings  of  meat  did  she  get? 
needs  to  get  the  lower  range  of  daily  servings.  6.  How  many  servings  of  fat  did  she  get? 

Here  are  her  daily  serving  goals: 

Milk  2  Meat  5  Bread  6  Vegetables  3  Fruit  2  Fat  3-4  Feedback: 

I  will  display  the  menu  again  with  all  serving  sizes  typed  in. 


.  Which  choice  will  supply  her  inissing  meat? 
4  Tbsp.  parmesan  cheese 
loz.  of  low-fat  Cheddar  cheese 
2  ecg  whites 


her  diet  possibly  deficient  in  calcium  and  iron. .  .2  very  common  deficiencies 
seen  in  women  all  over  the  world. 


INCORPORATING  GOOD  SOURCES  OF  VITAMINS  AND  MINERALS  INTO  A  FOOD  RECORD 
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and  grapefruit  are  good  sources  of  vitamin  C,  as  well  as,  jhe  foods  high  in  folate  are. .  .remember  “BOB  knows  his  ABC’s”, .  .so  the 

strawberries,  tomatoes  and  broccoli.  foods  high  in  folate  are  in  “c”  beans,  orange  juice,  Brussels’s 

Folate:  Think  of  the  pneumonic  :. .  .BOB  knows  his  sprouts. .  .asparagus,  brewer’s  yeast,  collard  greens  and  spinach. 

ABC’s . Beans,  Orange  juice,  Brussels 

sprouts . Asparagus,  Brewer’s  yeast,  Collard  greens  and  _ _ 


Spinach 

Beta-carotene:  to  help  you  remember  foods  high  in  beta- 
carotene  think  of  (carot)ene  =  carrots. . ..carrots  are  orange 
and  a  great  source  of  beta-carotene.... other  orange  foods  also 
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replace  the  apple  at  breakfast  with  calcium- fortified  orange  juice 
replace  the  romaine  lettuce  with  spinach 
all  of  the  above 
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Using  the  menu  above,  what  food/s  could  be  added  or  replaced  to  increase  the 
folate  content? 

A.  replace  the  apple  with  orange  juice 

B.  add  cantaloupe  slices  to  lunch 

C.  sprinkle  lTbsp»  of  brewer’s  yeast  over  the  cooked  pasta _ _ 


D.  replace  the  bagel  with  a  folate  fortified  breakfast  cereal  like  Total  or 
Product  19. 

E.  All  of  the  above 

Feedback:  All  of  these  will  increase  the  folate  content  of  the  menu.  Brewers 


APPENDIX  G 

INSTRUCTIONAL  STRATEGY 


Objective  Clusters 


Motivation: 

Will  use  3  computer  screens  before  program  begins  that  incorporate  the  ARCS  model  (Attention, 

Relevance  and  Confidence).. satisfaction  will  be  assessed  during  the  formative  evaluation  process. 
Attention: 

Statement  on  lifespan,  #  of  deaths  from  cardiovascular  disease  and  cancer,  %  of  Americans  who  are 
overweight  with  consequences  of  obesity. 

Relevance; 

Everyone  has  a  different  reason  for  wanting  or  needing  nutrition  information,  personal  appearance,  overall 
health  or  preventing  disease. 

If  you  have  a  family  history  of  heart  disease  it  may  be  because  you  want  to  take  all  precautions  possible  to 
prevent  heart  disease. 

If  you  are  a  mother,  you  may  want  your  children  to  be  healthy  and  help  them  avoid  obesity  and  chronic 
diseases  like  heart  disease  and  cancer. 

For  all  of  these  things,  nutrition  plays  a  vital  role. 

Confidence; 

Incorporating  good  nutrition  into  everyday  practice  is  not  rocket  science  or  brain  surgery,  it  is  as  simple  as 
choosing  the  best  foods  you  can  everyday,  every  meal,  every  food. 

By  learning  some  very  basic  tools  you  can  look  at  a  menu  and  determine  if  you  have  gotten  all  the  nutrients 
you  need  in  a  day.  You  could  look  at  a  food  label  and  decide  what  food  groups  the  item  will  fit  into,  you 
could  go  to  a  restaurant  and  look  over  the  menu  and  make  a  conscious  decision  as  to  whether  your 
selection  would  be  healthy.  You  could  evaluate  what  you  eat  in  a  day  and  know  if  you  have  gotten  enough 
of  certain  vitamins  and  minerals,  like  calcium,  iron,  antioxidants  and  folic  acid,  just  to  name  a  few. 

You  can  do  all  these  important  things,  but  you  have  to  begin  with  the  basics.  These  “basics”  are  very  easy, 
they  aren’t  glamorous,  but  they  lay  the  foundation  to  a  great  world  of  knowledge  and  skills  to  keep  you 
living  a  fulfilling  and  energetic  life. 


114 


115 


Objectives: 

Mpdule  1; 

In  this  module  you  will  learn  skills  that  enable  you  to  look  at  your  food  record  and  determine  if  it  meets  the 
recommended  requirements  and  how  to  make  the  appropriate  corrections  when  it  does  not. 

-You  will  learn  how  to  categorize  foods  into  the  6  food  groups 
-You  will  learn  the  calories  foxmd  in  each  food  in  a  food  group 
-You  will  learn  how  to  group  an  unfamiliar  food  into  a  food  group 
-You  will  become  familiar  with  serving  sizes 

Module  2: 

The  terminal  objective  for  module  2  will  be  stated  before  the  session  begins.  It  will  also 
encourage  students  to  complete  module  1  before  completing  this  module. 

In  this  module  you  will  determine  which  vitamin  and/or  mineral  is  of  concern  to  you  based  on  the 
food  groups  you  avoid  or  rarely  ever  eat.  Then  you  will  learn  how  to  incorporate  2-3  foods  that  are  good 
sources  of  these  vitamins  and/or  minerals  into  your  diet.  In  addition: 

-You  will  learn  how  much  of  the  vitamin  and/or  mineral  you  need  and  what  it  does  in  the  body 
-You  will  learn  the  many  food  sources  of  the  vitamin  and/or  mineral  to  determine  if  you  can  get 
enough  naturally 

-You  will  find  out  if  you  need  supplements  and  how  much  you  should  take 

-You  will  learn  ways  to  enhance  the  absorption  of  the  vitamin  and/or  mineral  and  things  you  may 

be  doing  that  decrease  the  absorption 

-You  will  learn  how  to  preserve  the  vitamin  and/or  mineral  when  you  prepare  foods  that  contain 
them 

Entry  Behaviors: 

On  the  entry  screen  to  each  module  under  the  objectives  I  will  add  a  statement  as  to  the  entry  behaviors 
that  are  expected, 

“In  order  to  get  the  most  out  of  this  program  you  should  know  basic  math  skills  such  as  adding  and 
subtracting.  For  example:  Vi  cup  plus  Vi  cup  equals  1  cup.  Or  %  cup  plus  !4  cup  equals  l/2c.  If  you  have 
trouble  doing  this,  then  you  may  have  trouble  completing  the  section  on  “calculating  multiple  servings.” 


Testing 

Module  1 

Module  2 

Embedded  test 

Post  Test  2  after  module  2 

Test  1  after  completing  cluster  1 

Test  2  after  completing  cluster  2 

Test  3  after  completing  cluster  3 

Post  Test  1  after  module  1 

Follow-up  Activities 

Remediation: 

Will  involve  feedback  as  to  why  their  answer  was  wrong,  then  another  opportunity  for  1  more  practice 
problem. 


Enrichment: 

Soxmds  will  play  when  they  complete  a  module  or  answer  a  practice  problem  correctly.  They  will  also  be 
told  where  to  get  additional  information  where  appropriate  (i.e.  vitamin/mineral  section) 
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Memory  Aid: 

Will  be  used  in  module  4  when  they  are  learning  which  foods  are  good  sources  of  vitamins  and  minerals. 
Transfer: 

Every  example,  practice  question  and  test  question  is  presented  in  the  context  in  which  it  will  be  used,  thus 
aiding  in  transfer.  Where  appropriate,  dining  out  scenarios  are  incorporated  because  people  eat  out  more 
today  then  ever  before. 


APPENDIX  H 

ONE-TO-ONE  GROUP  EVALUATION  INDIVIDUAL  INTERVIEW 

QUESTIONS 

I.  Clarity: 

Was  the  language  easy  to  understand? 

Was  the  information  presented  at  a  level  you  could  easily  understand? 

Were  the  objectives  for  each  lesson  clear  and  easy  to  understand? 

Do  you  feel  the  objectives  were  met? 

Were  the  explanations  clear  and  thorough? 

Was  the  information  presented  in  a  context  that  was  easy  to  relate  to? 

Did  the  examples  clarify  and  support  the  lesson? 

Were  the  illustrations  appropriately  placed  to  make  learning  easy? 

Were  there  any  sections  where  illustrations  were  needed  that  did  not  have  any  illustrations? 

Did  module  1  “Food  Groups  and  Serving  Sizes”  follow  a  logical  sequence  so  that  learning  Module  1  made 
it  easier  to  understand  Module  2  “Calculating  a  Serving  Size  of  a  Food”? 

Did  Module  2  “Calculating  a  Serving  Size  of  a  Food”  follow  a  logical  sequence  so  that  learning  Module  3 
“  Adding  A  Missing  Food  Group  Serving”  was  easier  to  understand? 

Was  the  Vitamin  and  Mineral  section  presented  in  a  way  that  will  make  incorporating  foods  high  in  the 
vitamin  and/or  mineral  of  concern  to  you  easy? 

Was  the  amount  of  information  for  each  post-test  too  large  and  complex? 

Were  the  colors  and  backgrounds  easy  on  your  eyes?  Yes  or  No 
Was  the  font  big  enough  so  you  didn’t  have  to  strain  your  eyes?  Yes  or  No 
Was  it  clear  how  to  move  from  one  screen  to  the  next?  Yes  or  No 

II.  Impact 

Do  you  feel  the  information  was  useful?  Yes  or  No 

How  easy  were  the  skills  to  learn?  Easy  OK 

Module  1  “Food  Groups  and  Serving  Sizes”  1  2  3 

Module  2  “Calculating  a  Serving  Size”  12  3 

Module  3  “Adding  Missing  Food  Groups”  12  3 

Module  4  “Vitamins  and  Minerals”  12  3 


Difficult 
4  5 

4  5 

4  5 

4  5 
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Do  you  feel  satisfied  with  the.  skills  you  learned  for  the  amount  of  time  to  complete  the  lesson? 


Not  Satisfied 

OK 

Satisfied 

Module  1 

1 

2 

3 

4 

5 

Module  2 

1 

2 

3 

4 

5 

Module  3 

1 

2 

3 

4 

5 

Module  4 

1 

2 

3 

4 

5 

Was  the  length  of  time  to  complete  the  program  to  your  satisfaction? 

Not  Satisfied  OK 

Satisfied 

Module  1 

1 

2 

3 

4 

5 

Module  2 

1 

2 

3 

4 

5 

Module  3 

1 

2 

3 

4 

5 

Module  4 

1 

2 

3 

4 

5 

Were  there  enough  examples  and/or  practice  problems  to  learn  the  skills  in  the  objectives? 

Too  Little  OK  Too  Many 

Module  1 

1 

2 

3 

4 

5 

Module  2 

1 

2 

3 

4 

5 

Module  3 

1 

2 

3 

4 

5 

Module  4 

1 

2 

3 

4 

5 

Were  the  directions  on  die  tests  and  the  test  items  clear  and  easy  to  imderstand?  Yes  or  No 

Do  you  feel  the  test  questions  tested  you  on  the  material  you  learned?  Yes  or  No 

Rate  the  amoimt  of  testing  embedded  into  the  program. 

Too  Little  Testing  OK  Too  Much  Testing 

1  2  3  4  5 

What  is  your  overall  impression  of  the  program? 

Poor  OK  Excellent 

1  2  3  4  5 


APPENDIX  I 

ATTITUDE  QUESTIONNAIRE 

A.  Attention:  To  what  degree  did  the  following  sections  hold  your  interest  or  attention? 


Instructional  Areas 

Attention  Levels 

Circle  one  level  for  each  section. 

Little  Very  Attentive 

1  2  3  4  5 

L  Familiarization  with  food  groups 

1  2  3  4  5 

2.  Serving  sizes 

1  2  3  4  5 

3.  Modifying  a  menu 

1  2  3  4  5 

4.  Vitamins  and  minerals 

1  2  3  4  5 

5.  Practice  Questions 

1  2  3  4  5 

B.  Relevance:  To  what  degree  do  you  believe  the  following  was  relevant  and  useful? 


No  Relevance  Very  Relevant 

1  2  3  4  5 

1.  Familiarization  with  food  groups 

1  2  3  4  5 

2.  Serving  sizes 

1  2  3  4  5 

3.  Modifying  a  menu 

1  2  3  4  5 

4.  Vitamins  and  minerals 

1  2  3  4  5 

5.  Practice  questions 

1  2  3  4  5 

C.  Confidence:  What  level  of  confidence  do  you  have  that  you  can  take  the  skills  of  the 
nutrition  lesson  and  apply  them  to  your  life? _ 


No  Confidence  Very  Confident 

1  2  3  4  5 

1.  Familiarization  with  food  groups 

1  2  3  4  5 

2.  Serving  sizes 

1  2  3  4  5 

3.  Modifying  a  menu 

1  2  3  4  5 

4.  Vitamins  and  minerals 

1  2  3  4  5 

D.  Satisfaction:  Overall,  how  satisfied  are  you  with  the  following  sections  of  the 
program: _ _ 


Not  Satisfied - Very  Satisfied 

1  2  3  4  5 

1.  Length  of  the  program 

1  2  3  4  5 

2.  Skills  acquired  in: 

a.  Grouping  foods  into  food  groups 

.1  2  3  4  5 

b.  Identifying  serving  sizes 

1  2  3  4  5 

c.  Modifying  a  menu 

1  2  3  4  5 

e.  Incorporating  good  sources  of  vitamins  and 
minerals 

1  2  3  4  5 

f  Overall  presentation 

1  2  3  4  5 
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E.  Clarity:  Were  the  following  areas  in  the  nutrition  lesson  clear  and  easy  to 


understand? 


Not  Clear  Very  Clear 

1  2  3  4  5 

1.  Objectives  for  each  module 

1  2  3  4  5 

2.  Familiarization  with  food  groups 

1  2  3  4  5 

3.  Serving  sizes 

1  2  3  4  5 

4.  Modifying  a  menu 

1  2  3  4  5 

5.  Vitamins  and  minerals 

1  2  3  4  5 

6.  Examples 

1  2  3  4  5 

7.  Practice  problems 

1  2  3  4  5 

8.  Practice  problem  feedback 

1  2  3  4  5 

9.  Overall  presentation 

1  2  3  4  5 

F.  Please  give  us  feedback  on  aspects  of  the  lesson  that  you  feel  are  strong  points  and 
weak  points  (areas  that  could  be  improved). 


APPENDIX  J 
PRE-TEST 


Objective  Measured 

Test  Item 

Entry  Behaviors 

1.  What  does  Vi  cup  plus  'A  cup  equal? 
a.  14  cup  b.  %  cup  c.  1  cup  d.  2  cups 

2.  If  1  serving  of  juice  is  equal  to  14  cup,  what  does  2 
servings  of  juice  equal? 
a.  14  cup  b.  1  cup  c.  1/8  cup  d.  V*  cup 

3.  What  does  1 10  80  equal? 

a.  1.4  b.  3  c.  2  d.  1 

Food  Groups  2.111, 2.112 

4.  What  food  group  do  olives  and  nuts  belong  to? 
a.  vegetable  b.  fat  c.  meat  d.  bread  e.  fruit 

Recommended  Daily  Servings  2.2 

5.  How  many  servings  of  meat  or  meat  alternative  is 
recommended  you  get  in  a  day? 

a.  1-2  b.  2-3  servings  c.  6-11  d.  3-5 

Missing  Food  Groups  2. 1 1 1 ,  2.3 

6.  What  food  group(s)  is/are  missing  from  this  meal? 

There  may  be  more  than  1  answer  here 

3  oz.  hamburger 

Hamburger  Bun 

Large  French  Fries 

Large  Soda 

a.  milk  b.  fruit  c.  vegetable  d.  starch  and  bread 
e.  meats 

Identifying  Good  Sources  of  Vitamins  and 
Minerals  4.2 

7.  What  are  good  sources  of  folic  acid? 

a.  Beans,  oranges,  Brussels  sprouts,  asparagus 

b.  Breakfast  cereal,  chicken,  milk,  yogurt 

c.  Milk,  cheese,  cottage  cheese,  spinach 

d.  All  of  the  above 
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Incorporating  Good  Sources  of  Vitamins  and 
Minerals  4 

8.  Does  this  menu  have  good  food  sources  of  beta- 
carotene? 

Brealrfast:  Cereal,  milk,  orange  juice 

Lunch:  Chicken,  mashed  potato,  steamed  green  beans, 
and  milk 

Dinner Meatloaf  cauliflower,  apple,  rice,  and  milk 
a.  Yes  b.  No 

Add  Appropriate  Food  in  the  Correct  Portion 
Size  2.5 

9.  Natalie’s  menu  is  missing  2  servings  of  vegetables. 

What  can  she  add  to  get  her  2  servings  of  vegetables? 

a.  2  cups  raw  baby  carrots 

b.  V2  cup  steamed  broccoli  and  1  cup  raw  cauliflower 

c.  V2  cup  cooked  green  beans  and  3  cups  cooked  com 

d.  A  and  B 

Recognize  multiple  serving  sizes  2.13 

10.  How  much  does  a  chicken  breast  weigh? 

a.  3  ounces  b.  6  ounces  c.  2  ounces  d.  9  ounces 

APPENDIX  K 

EMBEDDED  TEST  MODULE  1 
“Familiarization  with  Food  Groups” 
2.111  Name  the  food  group  on  the  p)^amid? 

A: _ 

B: _ 

C: _ 

D;  _ 


2.112 

1 .  Identify  which  5  foods  from  the  lists  below  are  found  in  the  Meat  group. 

a.  Eggs,  cheese,  salmon,  oysters,  hot-dogs 

b.  Eggs,  milk,  ham,  hamburger,  scallops 

c.  Pork,  beef,  turkey,  yogurt,  peanut  butter 

d.  Hamburger  bim,  English  muffin,  bagel,  black  eyed  peas,  nuts 

2.  Identify  which  foods  belong  in  the  Fat,  Sweets  and  Oils  group. 

a.  Nuts,  sour  cream,  cream  cheese,  coffee  creamer,  salad  dressings 

b.  Margarine,  mayonnaise,  bacon,  avocado,  com  oil 

c.  Cheese,  peanut  butter,  eggs,  brat  wmst,  salami 

d.  A  &  B 

e.  All  of  the  above 

3.  Identify  which  foods  belong  in  the  Fruit  group. 

a.  Dried  bananas,  tomatoes,  pears,  orange  juice,  fruit- flavored  yogurt 

b.  Watermelon,  oranges,  apple  juice,  grapes,  cantaloupe 

c.  Kiwi,  mangoes,  passion  fruit,  Jell-0,  crackers 

d.  Yogurt,  1%  Milk,  celery,  com,  lettuce 
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4.  Identify  which  foods  belong  in  the  Starch  and  Bread  Group. 

a.  crackers,  low-fat  potato  chips,  pretzels,  popcorn,  rice  cakes 

b.  mashed  potatoes,  com,  peas,  grits,  combread 

c.  tortillas,  beans,  biscuits,  waffles,  oatmeal 

d.  All  of  the  above 


APPENDIX  L 

EMBEDDED  TEST  MODULE  2 
“Serving  Sizes” 


2.113 

1.  The  serving  size  for  any  cooked  vegetable  is _ . 

a.  Ic.  b.  l/4c.  c.  l/2c.  d.  l/3c. 

2.  The  serving  size  for  rice,  baked  beans  or  couscous  is: 

a.  Ic.  b.  l/4c.  c.  l/2c.  d.  l/3c. 

3.  The  serving  size  for  milk  is: 

a.  Ic.  b.  l/4c.  c.  l/2c.  d.  3/4c. 

2.13 

1.  How  many  servings  of  Meat  Alternative  is  1  slice  of  cheese  and  2  eggs 
a.  1  b.  2  c.  3  d.  4 

2.11 

1 .  The  serving  size  for  a  piece  of  fruit  such  as  an  orange,  apple,  pear  or  peach 

a.  The  size  of  a  deck  of  cards 

b.  The  size  of  a  Tennis  Ball 

c.  2  Dominos 

d.  A  small  bowl 


Please  complete  the  two  questions  on  the  following  Page. 
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2.11 

2.  Identify  which  picture  represents  1  portion  size  of  oatmeal.  Draw  an  arrow  to  the 


correct  one. 


2.13 

2.  Identify  which  picture  is  3oz.  of  cooked  hamburger.  Draw  an  arrow  to  the  correct  one. 


APPENDIX  M 

EMBEDDED  TEST  MODULE  3 
“Modifying  A  Food  Record” 


2.1  (Calculating  Multiple  Servings) 

1.  If  a  serving  of  com  equals  l/2c.  then  how  many  servings  is  1  l/2c.  of  com  equal  to? 

a.  3  b.  2  c.  2  'A  d.  Vi 

2.  If  a  serving  of  crackers  is  6,  how  many  servings  does  9  crackers  equal? 

a.  1  b.  1  1/2  c.  2  d.  1/3 


2.2 

1.  How  many  servings  should  you  consume  from  the  milk  group  every  day? 

a.  2-3  b.  3  c  4  d.  none 

2.  How  many  servings  from  the  fruit  group  should  you  consume  everyday? 

a.  2-4  b.  1  c.  5  d.  3-5 


2.3  (Selecting  Missing  Food  Group) 

MENU 

Turkey  Sandwich 
1c.  raw  carrots 

2Tbsp.  Lovy^t  salad  dressing 
1  Diet  Coke 

Dolly  didn’t  consume  anything  from  the  fruit  group.  What  could  she  add  to  her  menu 
that  is  from  the  fruit  group. 

a.  orange  b.  loz.  potato  chips  c.  8oz.  Frait  Flavored  yogurt  d.  loz.  cheese 


2.4 

Joey  forgot  to  eat  vegetables  all  day.  He  loves  raw  cauliflower.  How  much  cauliflower 
will  he  need  to  eat  to  get  all  his  recommended  daily  servings  of  3  vegetables? 
a.  1  l/2c.  b.  2c  c.  l/2c.  d.  3c 


Please  complete  the  questions  on  the  following  page. 
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2.51 


Breakfast 

MENU 

Lunch 

Dinner 

lic.  orange  juice 

2g.  oatmeal 

2  slices  bread 

3oz.  chicken 

1/2c.  raspberries 

i^c.  skim  milk 

1c.  cooked  green  be 

ains  1c.  cooked  broccoli 

■dapple 

This  menu  does  not  have  enough  breads,  how  many  servings  are  missing  if  the  daily 
goal  is  11? 

a.  4  b.  5  c.  6  d.  2 


2.5 

Using  the  menu  above  select  the  food  below  that  would  allow  this  person  to  meet  all  of 
his  starch/bread  requirements  for  the  day.  (Remember  the  goal  was  1 1  servings) 

a.  2c  rice 

b.  2  l/2c.  mashed  potatoes 

c.  3  slices  of  bread 

d.  Ic.  peas 


APPENDIX  N 
POST-TEST  1 

Analyzing  and  Modifying  a  Food  Record 

Please  answer  the  following  questions  to  modify  this  menu  so  Roger  can  meet  his  daily 
food  goals. 

Roger’s  One  Day  Food  Record 

Breakfast _ Lunch _ Dinner _ 

1 1/2c.  com  flakes  2  slices  bread  4oz.  meatloaf 

1/2c.  milk  Itsp.  Regular-Fat,  1/2c.  acorn  squash 

ITbsp.  regular  margarine  mayonnaise  172c.  canned  peaches 

1  banana  3oz.  turkey  meat  Ic.  cooked  broccoli 

2  small  muffins  1 1/2oz.  pretzels  Small  Salad  f  1c.  lettuce) 

1  can  (8oz.)  V-8  juice  ITbsp.  regular  margarine 

He  is  a  tall,  lean  and  active  man  so  his  recommended  daily  servings  are  as  follows: 
Milk  3  Meat?  Bread  11  Vegetables  5  Fruit  4  Fat  3-6 

1.  How  many  servings  of  milk  did  he  get?  a.  14  b.  1  c.  2  d.  3 

2.  How  many  servings  of  bread  did  he  get?  a.  5  b.  7  c.  9  d.  1 1 

3.  How  many  servings  of  fruit  did  he  get?  a.  1  b.  2  c.  3  d.  5 

4.  How  many  servings  of  vegetables  did  he  get?  a.  1  b.2  c.  3  d.  5 

5.  How  many  servings  of  meat  did  he  get?  a.  2  b.  3  c.4  d.  5 

6.  How  many  servings  of  fat  did  he  get?  a.  6  b.  7  c.  8  d.  9 

7.  Which  food  groups  are  deficient  and  or  absent? 

a.  Milk,  bread,  fhiit 

b.  Milk,  meat,  vegetable 

c.  Milk,  bread  and  fat 

d.  Bread,  finit,  vegetable 

8.  How  many  servings  of  milk  is  he  missing? 

a.  2  b.  2  1/2  c.  4  d.  0 
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9.  How  many  servings  of  meat  is  he  missing? 

a.  1  b.  2  c.  3  d.  0 

1 0.  How  many  servings  of  fruit  is  he  missing? 

a.  1  b.  2  c.  3  d.  4 

1 1 .  Which  choice  will  supply  his  missing  fruit? 

a.  14  cantaloupe 

b.  1  orange  and  1  apple 

c.  l/2c.  apple  juice  and  1  pear 

d.  all  of  the  above 

12.  Which  choice  will  supply  his  2  missing  bread  servings? 

a.  l/2c.  pasta 

b.  1  dinner  roll 

c.  1  l/2c.  Com  Flakes 

d.  any  of  the  above 


APPENDIX  O 

POST-TEST  TWO,  MODULE  4 
Incorporating  Good  Sources  of  Vitamins  and  Minerals 

4.2  Please  answer  ONLY  the  Vitamins  and  Minerals  You  Reviewed. 

1 .  Please  select  the  choice  below  which  includes  all  foods  high  in  Folic  acid. 

a.  bread,  margarine,  olive  oil,  mayonnaise,  oranges 

b.  spinach,  Brussels  sprouts,  asparagus,  orange  juice,  cantaloupe 

c.  steak,  peas,  potatoes,  com,  mango 

d.  fortified  breakfast  cereals,  spinach,  rice,  mayonnaise,  peanuts 

2.  Please  select  the  choice  below  which  includes  all  foods  high  in  Vitamin  C. 

a.  orange  juice,  strawberries,  green  bell  peppers,  kiwi 

b.  sweet  potato,  green  beans,  peaches,  plums 

c.  bread,  margarine,  olive  oil,  mayonnaise,  oranges 

d.  steak,  peas,  potatoes,  com,  mango 

3.  Please  select  the  choice  below  which  includes  all  foods  high  in  Beta-Carotene. 

a.  steak,  peas,  potatoes,  com,  mango 

b.  fortified  breakfast  cereals,  spinach,  mango,  peanuts 

c.  carrots,  sweet  potato,  peaches,  cantaloupe,  spinach 

d.  orange  juice,  strawberries,  green  bell  peppers,  kiwi 

4.  Please  select  the  choice  below  which  includes  all  foods  high  in  Calcium. 

a.  figs,  spinach,  collard  greens,  broccoli 

b.  milk,  watermelon,  soy  milk,  cauliflower 

c.  steak,  peas,  potatoes,  com,  mango 

d.  orange  juice,  strawberries,  green  bell  peppers,  kiwi 

5.  Please  select  the  choice  below  which  includes  all  foods  high  in  IrpPt 

a.  pork,  spinach,  tofu,  Cream-of- Wheat  cereal 

b.  fortified  breakfast  cereals,  spinach,  mango,  peanuts 

c.  carrots,  sweet  potato,  peaches,  cantaloupe,  spinach 

d.  orange  juice,  strawberries,  green  bell  peppers,  kiwi 

6.  Please  select  the  choice  below  which  includes  all  foods  high  in  Vitamin  E. 

a.  fortified  breakfast  cereals,  spinach,  mango,  peanuts 

b.  safflower  oil,  mayoimaise,  almonds,  sweet  potato 

c.  pork,  spinach,  tofu,  Cream-of- Wheat  cereal 

d.  carrots,  sweet  potato,  peaches,  cantaloupe,  spinach 
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4. 


Sarah’s  Menu 

Breakfast 

Lunch 

Dinner 

2  waffles 

3oz.  bologna 

0  cli/'AQ 

3oz.  pork  sausage 

£  i  L/op.  uiiuer 

1/2g.  orange  juice 

^  UiCrCIvI 

13bsp .  mayonnaise 
tc.  gifeen  beans 

1  apple 

l-We  I  iilMWl  IwWi 

1c.  steamed  carrots 
1c.  whole  milk 

1.  Using  the  food  record  above,  select  the  replacements  that  will  increase  Sarah’s  Folic 
acid  intake. 

a.  Replace  waffles  at  breakfast  with  fortified  breakfast  cereal  and  replace  green 
beans  at  lunch  with  spinach  salad  and  sxmflower  seeds 

b.  Replace  bologna  and  bread  at  lunch  with  black  beans  and  yellow  rice  and 
replace  the  apple  at  lunch  with  cantaloupe 

c.  Replace  the  mashed  potatoes  at  dinner  with  great  northern  beans  and  replace 
the  carrots  with  Brussels  sprouts 

d.  A  and  B 

e.  All  of  the  above 

2.  Using  the  food  record  above,  select  the  replacement  that  will  increase  her  Vitamin  C 
intake. 

a.  Replace  bologna  and  bread  at  lunch  with  black  beans  and  yellow  rice  and 
replace  the  apple  at  lunch  with  cantaloupe 

b.  Replace  the  green  beans  with  a  spinach  salad  that  includes  sweet  peppers  and 
tomatoes  and  replace  the  carrots  with  cauliflower 

c.  Replace  the  mashed  potatoes  with  sweet  potatoes  and  replace  the  apple  with  a 
peach 

d.  A  and  B 

3.  Using  the  food  record  above,  select  the  replacement  that  will  increase  her  Beta- 
Carotene  intake. 

a.  Replace  the  mashed  potatoes  with  sweet  potatoes  and  replace  the  apple  with  a 
peach 

b.  Replace  the  orange  juice  with  milk  and  replace  the  green  beans  with 
cauliflower 

c.  Replace  the  waffles  with  Cream-of- Wheat  and  replace  the  mashed  potatoes 
with  black-eyed  peas 

d.  A  and  B 
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4.  Using  the  food  record  above,  select  the  replacement  that  will  increase  her  Calcium 
intake. 

a.  Replace  the  waffles  with  Cream-of- Wheat  and  replace  the  mashed  potatoes 
with  black-eyed  peas 

b.  Replace  the  orange  juice  with  milk  and  replace  the  green  beans  with  broccoli 

c.  Replace  the  mashed  potatoes  with  sweet  potatoes  and  replace  the  apple  with  a 
peach 

d.  A  and  B 

5.  Using  the  food  record  above,  select  the  replacement  that  will  increase  her  Iron  intake. 

a.  Replace  the  waffles  with  Cream-of- Wheat  and  replace  the  mashed  potatoes 
with  black-eyed  peas 

b.  Replace  the  orange  juice  with  milk  and  replace  the  green  beans  with 
cauliflower 

c.  Replace  the  mashed  potatoes  with  sweet  potatoes  and  replace  the  apple  with  a 
peach 

d.  A  and  B 

6.  Using  the  food  record  above,  select  the  replacement  that  will  increase  her  Vitamin  E 
intake. 

a.  Replace  the  mashed  potatoes  with  sweet  potatoes  and  replace  the  orange  juice 
with  mango 

b.  Replace  the  mashed  potatoes  with  a  tortilla  and  replace  the  apple  with  a  peach 

c.  Replace  the  mashed  potatoes  at  dinner  with  great  northern  beans  and  replace 
the  carrots  with  Brussels  sprouts 

d.  A  and  B 


APPENDIX  P 

E-MAIL  SURVEY  RESPONSES 


Overall  there  were  25  responses.  5  enlisted,  20  officers 

1 .  How  many  of  you  have  heard  of  the  Food  Guide  Pyramid? 

21/25  had  heard  of  the  pyramid.  All  enlisted  members  had  heard  of  the  pyramid  and  the 
4  who  had  not  were  officers. 

2.  What  do  you  know  about  the  p3Tamid? 

12  people  knew  the  pyramid  represented  the  food  groups  and  the  servings  we  should 
consume  each  day. 

4  people  stated  that  they  knew  foods  located  on  the  bottom  of  the  pyramid  should  be 
eaten  most  often  and  foods  at  the  top  of  the  pyramid  should  be  eaten  less  fi'equently. 

4  people  knew  nothing. 

2  people  made  references  to  an  extension  of  the  basic  4  food  groups. 

1  individual  reported  that  it  was  a  healthy  eating  guide. 

3.  If  a  computer  program  were  to  be  developed  what  would  you  like  to  know? 

There  were  many  varied  responses  fi'om  this  question. 

8  people  were  interested  in  Meal  Planning 
cooking  for  one 
meal/exercise  planner 
meal  planning/cooking 
how  to  measure  calories 
sample  menus  (3) 

practice  putting  meals  together  and  measuring  against  Recommended  Dietary 
Allowances  (RDA) 
time  of  eating 

6  people  were  interested  in  Foods  Link  to  Disease.s 
saturated  vs.  unsaturated  fat 
food  additives  and  pesticides 
cancer  risk 

how  we  process  foods 

5  people  wanted  to  know  the  Nutrient  Content  of  Foods 

calorie  content  and  nutrient  content 
5  people  were  interested  in  Nutritional  Requirements 
calories  per  day 
grams  of  fat  to  eat  each  day 
vitamin  and  mineral  needs  per  day 
how  to  get  all  the  RDA  each  day 
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2  people  were  interested  in  Dining  Out 

2  people  were  interested  in  Label  Reading 

1  person  wanted  Vegan  Diet  Information 

3  people  were  either  not  interested  or  knew  enough 

The  second  round  of  10  responses  which  ranked  the  above  said: 

First  Choice  Topic:  7/10  Meal  Planning 
Second  Choice  Topic:  5/10  Foods  Link  to  Disease 
Third  Choice  Topic:  7/10  Nutrition  Requirements 

4.  What  motivates  you  to  learn  about  nutrition? 

The  majority  of  people  stated  preventing  disease  and  staying  healthy  (13) 

Secondly,  they  wanted  either  to  maintain  Air  Force  weight  standards  or  lose  weight. 
Other  reasons  were  age,  children,  fads  and  fallacies  in  the  literatiue,  or  getting  fit. 

2  people  were  not  interested. 

5.  If  exercise  were  to  be  included,  what  would  you  like  to  leam  more  about? 

Most  people  responded  that  they  wanted  to  know  what  amount  of  exercise  will  bum  X 
amount  of  calories. 

The  second  most  popular  response  was  they  wanted  to  know  what  exercises  elicit  a  given 
response... weight  loss,  muscle  building,  lose  inches  firom  the  waistline,  help  prevent 
osteoporosis  etc. 

The  third  most  popular  response  was  how  to  maintain  a  balance  between  staying  fit  and 
preventing  injuries. 

There  were  a  number  of  other  responses  such  as: 
weekly  exercise  program 
weight  lifting 
motivation  tools 
food  intakes  for  training 
length  of  training  session 
exercise  basics 

The  second  roimd  of  1 0  responses  which  ranked  the  above  said: 

First  Choice  Topic:  8/10  The  type  and  amount  of  exercise  to  bum  “X”  calories 

Second  Choice  Topic:  8/10  What  exercises  will  elicit  a  given  response 

Third  Choice  Topic:  8/10  How  to  maintain  a  balance  between  being  fit  and  preventing 

injuries 


6.  Comfort  level  with  using  a  computer  for  education 
24/25  people  felt  very  comfortable  with  using  a  computer. 

2  people  stated  it  should  be  interactive  and  go  into  as  much  detail  as  the  user  wants.  One 
person  preferred  learning  in  a  group.  2  people  wanted  access  to  a  person  if  questions 
arose. 
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7.  What  feature  would  help  translate  the  information  into  the  real  world  setting? 

The  majority  of  people  responded  that  they  wanted  the  information  in  “plain  English” 
The  second  most  response  was  they  wanted  food  planning,  menus  and  exercise 
worksheets  printed  out. 

The  third  most  popular  response  was  personalized  information. 

Other  responses  included:  interactivity,  ease  of  use,  diet  journal,  visuals/graphs 
3  people  did  not  understand  the  question  and  2  said  they  could  think  of  nothing. 


The  second  round  of  10  responses  which  ranked  the  above  said: 

First  Choice  Topic:  5/10  Plain  English ,  4/10  said  printable  worksheets 

Second  Choice  Topic:  5/10  Printable  Worksheets,  4/10  said  personalized  information 

Third  Choice  Topic:  5/10  Personalized  Information,  4/10  said  plain  English 


8.  How  long  would  you  be  willing  to  sit  at  the  computer? 

The  majority  of  people  responded  15-30  minutes  at  a  time  (16) 

4  said  45  minutes,  2  hours,  2  hours  per  week,  2  horns  per  month 


In  summary,  all  but  four  people  had  heard  of  the  Food  Guide  Pyramid.  They  knew  it 
represented  the  food  groups  and  servings  we  should  eat  everyday.  They  also  knew  that 
the  bottom  had  foods  that  should  be  consumed  often  and  foods  at  the  top  should  be 
consumed  least  often.  The  topics  people  were  most  interested  in  learning  about  were 
meal  planning  (#1),  food  and  it’s  link  to  diseases  (#2)  and  daily  nutrient  requirements 
(#3).  The  main  things  that  motivate  people  to  learn  about  nutrition  are  living  a  healthy 
lifestyle,  preventing  disease  and  personal  appearance  in  regards  to  weight.  When  asked 
what  exercise  topics  interested  them,  the  majority  of  people  wanted  to  know  how  much  of 
a  certain  exercise  expended  a  given  amount  of  calories  (#1),  next  (#2)  they  wanted  to 
know  what  exercises  elicited  a  given  response,  and  lastly  (#3)  they  wanted  information  to 
know  how  to  maintain  a  balance  between  staying  fit  and  preventing  injuries.  Overall, 
everyone  felt  comfortable  using  a  computer  for  educational  purposes  and  would  sit  at  a 
computer  for  1 5-30  minutes  at  a  time  to  learn  about  nutrition.  Lastly,  the  feature  they 
stated  would  help  translate  knowledge  into  practice  was  “plain  English”  (#1)  and 
printable  worksheets  on  exercise  (#2),  meal  planning  and  menus  (#3). 


APPENDIX  Q 

SUMMARY  RESULTS  FOCUS  GROUP  ONE 


1 .  How  many  of  you  have  heard  of  the  Food  Guide  Pyramid?  Response:  all  of  them 

2.  What  things  do  you  already  know  about  the  Food  Guide  Pyramid? 

-  You  shouldn’t  have  any  junk  food 

-  A  pyramid  of  things  that  will  never  happen,  that  nobody  goes  by  but  say  they  do 

-  You  are  suppose  to  have  a  certain  number  of  servings  from  each  part  of  the  pyramid,  in 
each  group. ..but  that  doesn’t  happen 

-  I  know  when  I’m  hungry  and  what  I  can’t  eat  and  I’m  not  gonna  base.. .I’m  one  of  those 
people  if  I’m  himgry  I’m  gonna  eat  no  matter  how  much  weight  I  gain.  I’m  gonna  eat  till 
I’m  full  and  satisfied. 

-  I  know  about  the  same  as  she  does. ...seen  it,  heard  it,  but  don’t  really  have  much  of  the 
details  of  it. 

-  Know  about  the  same  thing  that  she  said,  about  how  many  servings  you  are  suppose  to 
have  for  each  of  the  food  groups,  all  the  food  groups  are  based  on  the  pyramid  of  what 
you  are  suppose  to  have,  and  each  food  group  you  are  suppose  to  have  each  day. 

-  I  can’t  remember  what  all  the  food  groups  are. 

-  Bottom  part  is  the  bread  and  cereal  group  and  we  should  have  more  of  that,  and  fats  are 
at  the  top.  And  we  should  have  a  certain  amount  each  day  but  I  don’t  remember  how 
many. 

3.  Does  anyone  know  what  the  servings  are? 

-  ifyou  gave  me  a  test  on  it.... no 

-  Well  I  think  the  pyramid  is  set  by  a  standard  but  each  person’s  body  is  different.  Each 
person  has  to  kind  of  figure  out  ....I  see  that  there  are  8-10  servings  of  the  bread  group  but 
my  body  can’t  handle  that  so  I  eat  more  vegetables  and  protein  but  I  don’t  hardly  eat  any 
red  meat  though.  I  tend  to  swell  with  more  carbs.  As  far  as  the  nutrition  guidelines  go 
they  give  you  a  mediocre  standard  of  what  you  are  suppose  to  have. 

-  It  depends  on  the  person’s  schedule,  if  the  person  doesn’t  have  time  to  sit  there  and  say 
I  gotta  eat  at  this  and  that  time,  I  gotta  eat  as  I  go  cause  I  don’t  know  when  the  next  time  I 
will  eat.  Like  me,  I  live  far  away  that  I  try  to  eat  before  5  and  7  and  not  so  heavy  because 
anything  after  that  is  just  gonna  sit  and  it  depends  on  anyone’s  schedule  and  how  much 
you  eat. 

4.  If  we  were  to  develop  a  computer  a  program  to  teach  you  about  basic  nutrition  and 
concentrate  on  the  food  guide  pyramid,  what  specific  types  of  information  would  be  most 
helpful  to  you? 
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-  When  I  pick  up  magazines  and  I  read  things  that  say  how  many  grams  of  beta-carotene 
you  need  in  a  day  I  don’t  understand  it,  I  need  to  know  exactly  how  much  is  that  and  what 
do  I  need  a  day.  Moderator:  “Would  it  be  easy  to  have  pictures  of  the  foods  that  contain 
beta-carotene  and  this  is  how  much  you  would  need  a  day  to  get  the  recommended 
amoimt....so  you  want  visual  images?”  Answer:  definitely,  yes... Moderator:  Like 
pictures  on  the  computer  screen  would  be  helpful.. .not  just  words?  Answer:  “Yes” 

-  Also  put  why  you  need  it,  but  some  people  might  know  what  zinc  is  good  for  or 
potassium  is  good  for  and  all  that  stuff,  they  just  might  know  that  they  need  it  but  not 
know  why  they  need  it. 

Moderator:  “Would  it  be  safe  to  say  that  you  both  are  more  interested  in  the  nutrients 
rather  than  the  specifics  in  the  pyramid?”  person  #1  Yes.  person  #2  Yes,  I  need  to  know 
what  I  need  in  a  day. 

-  I  think  you  need  more  results/consequences  and  include  the  long-term.  Like  if  I  eat 
this  fat  what’s  gonna  happen  to  you.. ..look  at  the  long-term.  Not  just  say  I  ate  a 
hamburger  here  and  ate  a  hamburger  here  and  I  can  run  30  minutes  and  knock  it  off  but 
more  like  let’s  say  you  ate  those  3  hamburgers  and  you  would  have  to  exercise  for  say  5 
hours  to  bum  that  which  you  just  did.  Makes  you  think  twice  before. 

-  You  really  have  to  emphasize  cause  and  effect. 

-  Dieting  doesn’t  work  unless  you  exercise... let  them  know  that  if  you  skip  meals  your 
body  restores  fat  and  the  next  time  you  eat  it  will  do  it  even  more.  I  think  the  AF  in 
general  should  have  an  exercise  program.  You  have  to  get  people  to  maintain  the 
standard  so  you  have  to  make  them  sometimes.  I  think  the  AF  needs  to  do  that,  I  think 
the  AF  has  the  fattest  people. 

-  What  about  meal  preparing? 

-  I’m  stressed  for  time... what  fast  foods  are  good  for  me? 

Moderator:  “  Do  you  think  that  it ’s  good  to  emphasize  the  weight  standard?  ” 

-  Yeah.. .if  you  don’t  meet  the  body  fat  and  all  that  that’s  goima  make  someone  start 
thinking  they  need  to  exercise  and  need  to  learn  more  about  the  diet. 

-  no 

-  the  standards  are  not  fair  and  they  don’t  take  into  account  the  different  body  types. 

-  the  different  exercises  they  have  in  the  magazine,  I  look  at  the  meals,  and  I  look  at 
labels. 

Moderator:  What  about  when  you  go  into  a  grocery  store,  what  information  is  important 
for  you  to  know?  How  do  you  make  one  selection  versus  another? 

-  Habit,  what  I  grew  up  on. 

-  If  you  are  in  the  commissary  around  here  and  you  stop  to  read  a  label,  then  you  get  run 
over.  If  the  label  says  fat  free  then  I  will  grab  it,  but  I  will  not  sit  there  and  read  the 
labels.  I  get  in  and  out  of  the  store...  that’s  the  way  I  am. 

-  Throughout  my  life  I  have  heard  that  there  are  certain  foods  that  bum  calories  quicker 
or  work  chemically  with  over  foods  to  help  you  lose  weight  and  keep  cravings  down  and 
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keqj  you  hydrated.  That’s  stuff  I  like  reading  about.. ..like  I  have  always  heard  that 
grapefruit  juice  bmns  more  calories  because  of  the  acids. 

Moderator;  So  in  the  computer  program,  we  would  steer  you  away  from  these 

diets.. .would  you  want  to  know  which  things  are  scientifically  based.. .what  there  claim  is, 

so  you  should  know  if  you  should  pay  attention  to  things  like  that. 

-  Yeah... I  think  a  lot  of  nutrition  is  based  on  mental  capabilities.  I  would  eat  5-10  grams 
of  fat  a  day  and  then  I  would  give  myself  a  treat  and  it  would  have  25  grams  of  fat  I 
would  psyche  myself  out  and  the  next  day  I  would  be  4  pounds  heavier. 

5.  If  exercise  were  to  be  included  as  part  of  the  computer  program,  what  things  would 
you  like  to  know? 

-  Which  exercises  do  what  for  your  body. 

-  Which  exercises  work  with  which  foods  to  get  certain  parts  of  your  body  in  shape. 

-  Length  and  time... the  treadmills  here  tell  you  the  time  needed  for  burning  fat  but  a  lot 
of  people  don’t  have  a  treadmill,  so  what  other  exercises  would  benefit  you  in  the  same 
and  how  long  would  you  have  to  exercise  to  see  benefit. 

-  I  like  to  target  certain  areas  of  my  body  to  lose  weight  so  when  I  look  at  magazines, 
that’s  exactly  where  I  go.  This  is  where  I  want  to  lose  so  this  is  what  I  do  and  I  would 
like  to  know  how  long  it  will  take. 

-  I  like  to  hear  people’s  stories....!  just  wonder  what  things  they  do  and  what  machines 
they  use.  I  like  to  hear  success  stories  and  pictures  before  and  after. 

-  Want  specific  recommendations.... if  you  do  this  and  do  it  this  way... show  the  end 
result. 

-  A  lay  person  will  only  see  A  and  B,  where  a  doctor  or  a  dietitian  sees  all  the  chemistry, 
it  can’t  be  anything  too  complex  or  I  won’t  go  there... keep  it  simple. 

-  I  don’t  place  a  big  emphasis  on  it  because  the  military  doesn’t  place  a  big  emphasis  on 
it. 

6.  How  comfortable  do  you  feel  using  a  computer  for  educational  lessons? 

-  all  responded  they  feel  very  comfortable  using  a  computer 

-  everything  we  do  now  is  computerized 

7.  Tell  me  what  would  help  you  use  the  nutrition  information  from  the  computer  program 
in  your  everyday  life?  What  are  some  features  that  you  think  should  be  included? 

-  The  computer  should  be  able  to  print  out  information  like  diets 

-  Personalize  the  information 

-  Keep  the  information  up-to-date 

-  Attention  getting  and  then  get  the  person  to  apply  the  information 

-  On  the  internet,  mind  quizzes  or  games,  crossword  puzzles 

-  Questions  along  the  way  are  good 

-  Make  it  interactive,  a  diagnostic  tool,  if  I  want  to  know  about  my  health,  let  me  put  in 
my  height  and  weight  and  let  the  computer  give  the  result  on  how  much  I  should  weigh. 
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-  Have  the  computer  tell  what  will  happen  5  to  10  years  from  now  if  they  keep  eating  the 
way  they  are  eating  now. 

-  Compare  them  with  the  civilian  population... give  them  comparisons  so  they  know 
where  they  are  at. 

-  Incorporate  health  risk  that  are  involved.... by  not  burning  off  this  much  fat,  or  eating 
this  much  fat  this  is  what  your  risk  is. 

8.  How  long  should  a  lesson  on  basic  nutrition  should  last? 

-  30-35  minutes  especially  if  it’s  during  the  duty  day 

-  20  -25  minutes  is  what  would  keep  my  attention  if  it  were  interactive 
-15  minutes 

-  You  want  to  give  them  all  the  facts  and  be  knowledgeable  but  don’t  make  it  mundane 
and  boring...attention  getters,  jokes, 

-  Do  it  in  modules 

-  Make  it  so  you  can  get  back  to  where  you  stopped 

-  Give  them  the  basics  and  tell  them  where  they  can  find  more  information  if  they  want 
it... then  have  pamphlets  and  books  at  a  convenient  location,  or  list  links  to  other  web 
sites. 

9.  In  what  setting  would  you  like  to  have  access  to  and  use  the  computer  program? 

-  work,  access  to  web,  touch  screens  in  the  commissary,  hospital  clinics,  grocery  stores, 
gym 


In  summary,  all  participants  had  heard  of  the  Food  Guide  Pyramid  but  no  one 
knew  what  the  food  groups  were  or  how  many  servings  of  each  group  they  should  have 
each  day.  One  individual  knew  that  the  breads  and  cereals  group  was  on  the  bottom  and 
that  meant  we  should  have  the  most  of  this  and  fats  were  on  the  top  and  we  should  have 
the  least  of  this.  They  knew  they  were  suppose  to  eat  a  certain  munber  of  servings  from 
each  group  a  day  but  1)  had  no  idea  what  that  number  was,  2)  believed  they  were 
unrealistic,  3)  believed  they  were  not  individually  based,  or  4)  thought  for  people  with 
time  constraints  it  was  hard  to  follow. 

When  asked  what  specific  types  of  information  would  be  the  most  helpful  to  them 
they  cited  the  following.  They  were  interested  in  pictures  of  foods  that  provide 
important  vitamins  and  minerals  and  how  much  of  those  foods  they  should  eat  everyday. 
They  also  wanted  to  know  the  consequences  of  their  food  choices  over  the  long-run  in 
terms  of  disease  states  and  weight  standards.  One  individual  was  interested  in  meal 
preparation  and  everyone  agreed  with  him.  Another  person  wanted  to  know  healthy  fast- 
foods.  Lastly,  one  individual  was  interested  in  the  scientific  studies  to  support  fad  diet 
claims  such  as  the  “Grapefimit  Diet”.  When  asked  about  label  reading,  three  individuals 
chose  foods  out  of  habit  or  cited  time  constraints  that  kept  them  from  reading  labels. 

In  regards  to  exercise,  everyone  was  interested  in  this  topic.  They  wanted  to 
know  what  exercises  were  good  for  certain  body  parts,  the  length  and  time  an  exercise 
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session  should  last  to  get  certain  results.  They  did  not  want  all  the  “chemistry”  behind  it 
just  the  results. 

All  participants  felt  very  comfortable  using  a  computer  for  educational  purposes. 
The  features  they  wanted  most  were  the  following.  They  wanted  interactivity  in  the  form 
of  games,  word  puzzles,  and  questions.  They  wanted  personalized  information  in  regards 
to  how  much  they  should  weigh  for  their  height  and  what  the  health  risk  are  if  they  aren’t 
at  that  weight.  They  wanted  information  in  15-20  minute  modules  so  they  could  skip 
information  that  they  were  not  interested  in.  They  also  wanted  a  reference  at  the  end  of 
the  module  to  get  more  information  should  they  be  interested  in  that  topic.  They  wanted 
“attention  getters,  ’’jokes,  humor,  anecdotal  evidence  of  exercise  and  dieting  success 
stories.  They  thought  seeing  the  future  consequences  of  actions  today  would  make  them 
alter  their  behavior.  Lastly,  they  wanted  a  diet  analysis  that  could  be  printed  out. 

The  setting  they  would  most  like  to  have  access  to  this  information  is  at  their  desk 
at  work,  on  the  internet,  at  the  gym,  hospital  clinic  waiting  areas,  and  grocery  stores. 


APPENDIX  R 

SUMMARY  RESULTS  FOCUS  GROUP  TWO 


1.  How  many  of  you  have  heard  of  the  Food  Guide  Pyramid? 

-Response:  3/8  had  never  heard  of  the  Food  Guide  Pyramid. 

2.  What  things  do  you  already  know  about  the  Food  Guide  Pyramid? 

-  “It  is  shaped  like  a  triangle.  I  honestly  don’t  remember  what  the  groups  are  or  how 
many  there  are... I  know  there  are  general  categories  like  breads  and  meats  but  I  honestly 
don’t  remember.” 

-  “I  know  you  are  suppose  to  eat  certain  portions  from  each  group  but  I  don’t  remember 
how  many... I  don’t  use  it  so  I  don’t  know  that  much  about  it.  I  have  seen  it  and  read 
about  it.” 

-  “I  know  the  food  groups  from  my  child  hood  but  I  have  never  seen  the  pyramid.” 

-  “I  know  it’s  a  pyramid  and  I  read  it  all  the  time  because  it  is  on  the  outside  of  the  cereal 
boxes.  I  know  that  at  the  top  is  fats  and  oils  and  you  are  not  suppose  to  have  very  much 
of  these.  And  at  the  bottom  I  know  there  are  vegetables  and  fruits  and  you  are  suppose  to 
have  the  most  of  those  but  the  stuff  in  the  middle  I  always  forget.” 

-  “I  was  going  to  draw  it.  I  know  all  the  food  groups  and  where  they  go.  I  read  a  lot  and 
read  the  Time  Life  Series. 

-I  know  you  are  suppose  to  have  lots  of  fruits  and  vegetables  but  I  don’t  know  the 
portions  of  each. 

-Never  had  any  training  in  it.  I’ve  seen  it  a  couple  of  times  but  I  don’t  remember  where. 
Couldn’t  tell  you  what’s  in  it,  or  how  to  use  it. 

-Never  seen  it,  never  heard  of  it,  couldn’t  tell  yah  nothin’  about  it. 

-I  know  all  the  stuff  in  it,  all  the  servings  in  it,  the  whole  bit.  Like  the  grains  are  suppose 
to  be  6-1 1  and  I  know  that  a  slice  of  bread  is  one  serving,  and  then  it  goes  fruits 
vegetables  and  meats  and  dairy  on  the  same  level. 

Moderator:  If  you  see  the  Food  Guide  Pyramid  are  you  completely  opposed  to  learning 
information  from/about  the  pyramid. 

-I  like  to  read  the  information  from  the  pyramid.  Everyone  concurred. 

3.  If  we  were  to  develop  a  computer  program  to  teach  you  about  the  basic  nutrition 
information,  what  specific  types  of  information  would  be  the  most  helpful  to  you? 

-It’s  OK  to  use  the  pyramid  as  the  foundation  of  your  teaching  but  you  have  to  make  it 
important  to  them  if  you  want  them  to  pay  attention  to  it. 

Moderator:  What  motivates  you  to  learn  something : 
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To  have  a  long  fiill  life,  in  the  military  you  got  help,  you  got  the  weight  standard.  For  me 
it  would  be  fitness  and  short  cut  tips  like  why  I  should  grab  the  carrots  instead  of  the 
potato  chips.  Another  individual  said:  “Helpful  hints  to  be  more  healthy  and  fitness  tips.” 
Losing  weight  motivates  me.  Quality  of  life.  Weight  loss,  weight  standards,  physical 
appearance. 

Moderator:  If  there  were  to  be  a  computer  screen  that  gave  helpful  hints  comparing  the 
two  foods  what  things  would  motivate  you  to  read  it  and  adopt  the  healthy  food? 

“How  many  less  miles  you  would  have  to  jog.”  “I  like  to  jog,  how  many  more  miles 
could  I  jog.” 

“Some  people’s  motivation  is  to  lose  weight  but  my  motivation  is  to  improve  my 
performance  because  I  could  eat  all  day  long  and  ever  gain  any  weight,  but  if  I  eat  cakes 
and  sweets,  I  can’t  run  as  far  or  as  good.” 

Back  to  the  pyramid  information: 

“You  almost  have  to  start  at  a  very  elementary  level  and  explain  how  your  body  uses  fats 
and  carbohydrates.” 

“Yeah,  that’s  what  I  need,  I  don’t  know  nothin’  about  that  stuff  I  don’t  know  anything 
about  saturated  fats  and  I  need  to  know  stuff  like  that.” 

“I  would  like  to  know  something  about  vitamins,  yah  know  you  read  stuff  about  vitamin 
A  and  how  it  helps  to  do  this,  they  got  so  many  different  vitamins  and  things  like  that  that 
is  suppose  to  help  blood  move  faster  and  your  bones  and  all  that.  I  try  to  read  up  on  it  but 
it’s  so  many  I  don’t  know  what  would  help.” 

“What  would  also  be  helpful  would  be  how  much  of  the  vitamin  to  take,  upper  and  lower 
limits,  and  then  tell  us  how  to  get  it.. .like  3  glasses  of  milk  will  give  us  our  calcium.” 
“What  made  an  impression  to  me  was  a  video  I  saw  where  they  sliced  open  someone  with 
a  blocked  artery  and  they  pulled  out  this  big  tube  of  blocked  fat  stuff.  If  that’s  not 
enough  to  gross  you  out  and  change  your  diet  I  don’t  know  what  will.” 

“Yeah,  if  you  could  explain  the  long-term  effects,  cause  a  lot  of  people,  if  you  don’t  see 
an  instant  effect,  if  you  are  eatin’  a  burger  and  you  don’t  explode  then  a  lot  of  people 
assume  it’s  OK  to  eat  this  stuff” 

“I  would  want  to  know  grams  of  fat,  what  would  make  me  look  good  and  keep  me  slim 
and  trim.  But  if  you  put  this  stuff  in  my  face,  I  will  eat  it  to  make  the  weight  standard  but 
then  I  will  revert  back  to  the  good  tastin’  foods.  So,  if  you  can  make  it  with  the  right 
grams,  and  good  taste,  then  I  could  stay  on  it  forever.” 

“Yeah,  yah  know,  people  always  diet  to  fix  their  problems  but  it’s  really  suppose  to  be  a 
lifestyle  change  where  you  eat  healthy  all  the  time  and  maybe  once  a  week  you  go  out 
and  eat  the  fiied  chicken  and  chocolate  cake.” 

“And  give  examples  of  how  to  make  everything  fit.  How  much  of  things  can  you  eat? 
Substitutions  for  high  fat  ingredients  in  recipes  would  be  good  too.” 

“Yeah,  that  is  what  I  need.” 
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-  “I  have  a  record,  so  if  I  slack  off  it  falls  apart.  A  checklist  motivates  me...cause  I  see  my 
progress.” 

-  “If  you  tell  me  what  the  long-term  consequences  are  then  I’m  gonna  do  it.” 

-  “What  motivates  me  is  to  change  one  little  thing  at  a  time,  the  goal  will  come  if  I  do  the 
little  things  everyday,  then  it  slowly  becomes  a  lifestyle  change.” 

So,  do  you  want  a  list  of  goals  or  do  you  want  to  come  up  with  them  on  your  own? 

-  “Yeah,  like  maybe  a  list  that  we  can  choose  from.”  Everyone  concurred. 

7.  How  long  should  a  computer  program  be? 

-  Everyone  agreed  about  15  minutes  per  module 

-  “If  it’s  longer  than  the  computer  screen  then  I  don’t  like  that.. ..I  don’t  like  scrolling 
down.  I  guess  it  depends  on  if  you  are  a  beginner  or  more  advanced,  then  it  may  take 
longer. 

-  “It  also  depends  on  the  motivation  of  the  person... if  someone  wants  the  information, 
they  will  spend  longer  on  it,  if  it’s  mandatory  then  I  would  want  it  shorter.” 

-  “I  also  think  you  should  list  the  objective  and  the  time  length  to  complete  the  module, 
but  if  it  says  it  will  take  20  minutes  then  I  won’t  do  it.” 

-  “For  us  what  would  be  helpful  is  to  put  it  on  the  web.” 

“I  like  questions  along  the  way  but  not  too  many  of  them  and  if  you  give  the  wrong 
answer,  it  should  explain  what  the  right  answer  is.” 

Focus  Group  #2. 

In  summary:  3/8  had  never  heard  of  the  Food  Guide  Pyramid.  The  people  that  had  heard 
of  the  pyramid  knew  it  was  shaped  like  a  triangle,  fats  and  oils  are  at  the  top,  they  knew 
they  were  suppose  to  eat  lots  of  fruits  and  vegetables,  one  person  actually  knew  all  the 
groups,  servings  and  foods  within  each  group.  The  nutrition  topics  requested  were 
vitamins  found  in  foods  and  safe  amounts,  long-term  consequences  of  daily  nutrition 
habits,  adopting  healthy  lifestyle,  start  simple-such  as  how  the  body  uses  carbohydrates, 
proteins  and  fats  and  lastly  recipe  substitutions.  The  things  that  motivate  them  to  learn 
about  nutrition  are:  living  a  long-full  life,  maintaining  the  weight  standards  and  personal 
appearance.  The  exercise  topics  requested  were  what  exercises  bum  fat,  how  much 
exercise  will  bum  “X”  calories,  recommendations  specific  to  their  exercise  goal  (losing 
weight,  improving  fitness  etc.).  They  all  felt  comfortable  using  a  computer  for  education 
but  didn’t  prefer  to  sit  at  the  computer  for  long  amounts  of  time,  they  all  agreed  about  15 
minute  per  module  was  appropriate.  In  fact,  7/8  of  them  said  they  don’t  prefer  this 
method  of  instmction  if  all  they  do  is  sit  and  read  off  the  computer.  3/8  said  it  would  be 
better  if  the  program  was  interactive  and  had  multimedia.  When  asked  what  would  help 
them  translate  the  education  into  daily  use,  they  replied:  goals,  support,  keeping  records, 
having  to  answer  to  someone,  long-term  consequences  and  emphasizing  through  small 
changes  to  adopt  a  healthy  lifestyle. 


APPENDIX  S 

RESULTS  OF  DIETITIAN  SURVEY 

Air  Force  Dietitian  Needs  Assessment  Questionnaire 
31/35  Responses 

1 .  How  many  clients  in  a  week  ask/see  you  for  basic  nutrition  information  i.e.  a  lesson 
that  requires  teaching  basic  principles  of  the  Food  Guide  Pyramid  (FGP)? 

_ ^None  (skip  to  question  4) 

U _ 0-5 

1  _ 5-10 

2  _ 10-15 

6  >15 


2.  The  clients  requesting  this  information  are:  Please  check  the  one  occurring  most 
frequently. 

RANK(s): 

10  E-4  &  below  ^  E-5  &  above _ 0-1  to  0-3 _ ^0-4  &  above 

_2  Family  Members  Don’t  know 
AGE  (s): 

4  18-25vrs  15 _ 26-35yrs  J_  36  and  older  5 _ Don’t  know 

SEX:  15  female _ ^male 

MARITAL  STATUS: 

15  married  2 _ single  14  don’t  know 

3.  What  topics  are  typically  covered  in  this  counseling  session?  Check  all  that  apply. 

X  Food  groups 

_X_  Serving  sizes 

_  Recommended  calorie  level  for  weight  loss/maintenance/gain 

_  Number  of  serving  from  each  food  group  to  meet  a  given  calorie  level 

X  Food  label  reading 

_  Exercise  recommendations 

_  Low-fat  eating 

_  Vitamin/  Mineral  content  of  foods 

_  How  to  plan  menus 

OTHER:  Of  note,  the  topics  typically  not  covered  in  a  counseling  session  were  meal 
planning,  vitamin  and  mineral  contents  of  foods,  and  exercise  recommendations, 

4.  Do  you  have  access  to  a  computer  for  client  use? 

Yes _ No  20 
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Could  get  one/ use  one  that  is  already  in  place.  YesJJ  No  Please  check  one. 

5.  Would  you  use/recommend  a  computer  program  to  clients  requesting  this 
information? 

Yes  19 

No  4  Why  not?  Personal  attention 
Not  Sure  S 

6.  Are  you  currently  using  a  computer  software  program  to  teach  basic  nutrition 
principles  to  clients?  If  yes,  which  one?  If  no,  go  to  question  9. 

3 _ Yes  Titled:  Pyramid  Challenge.  On-line  health 

28  No  Go  to  question  9. 

7.  What  do  you  like  about  the  program? 

X  Graphics 

X  Content 
_ ^Practice  questions 

X  Nutrient  databases  for  diet  recall  are  complete 

_ ^Exercise  session  time  increments  are  appropriate  for  my  audience 

OTHER: _ _ 


8.  What  would  you  like  to  see  improved/added? 

_ Graphics 

_ Content 

X  Practice  questions 
X  Nutrient  databases  for  diet  recall 

_ Exercise  session  time  increments 

OTHER: _ 


9.  Do  you  see  a  need  for  a  computer  program  that  provides  basic  nutrition  information 
(teaches  the  principles  of  the  Food  Guide  Pyramid)  ?  If  no,  please  state  why  and  tell  me 
what  you  do  see  a  need  for. 

Yes  28 

No  8  Why  not?  Education  materials  already  there,  diet  technicians  do  this, 
commercial  ones  out  there,  lose  their  jobs,  they  liked  interacting  with  clients 
What  do  you  see  a  need  for?  Interactive,  user  friendly,  motivational  tools 

10.  If  a  computer  program  was  to  be  developed  that  taught  basic  nutrition  principles, 
what  would  you  like  to  see  included?  Please  rank  the  topics  below  (1-8)  from  most 
wanted  to  least  wanted.  1  being  the  most  needed/wanted  to  8  being  the  least  wanted 

_ 1 _ ^Identify  the  food  groups  in  the  Food  Guide  Pyramid 

2  Identify  appropriate  serving  sizes  for  each  food  group 
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_4/7  _Practice  questions  that  address  correct  foods  in  a  food  group 
_ 3  Practice  questions  that  address  correct  serving  sizes 

_ 5  Practice  questions  that  require  the  client  to  complete  a  days  menu  using  the  Food 

Guide  Pyramid 

_ 8 _ Calculation  of  ideal  body  weight 

_ Identify  the  correct  number  of  servings  from  each  food  group  to  meet  given  calorie 

level 

_ 3/6_How  to  read  food  labels 

OTHER: _ _ _ 


1 1 .  Would  you  want  this  program  to  be  all  inclusive,  meaning  that  it  will  replace  your 
basic  diet  instruction  and  patients  would  be  instructed  to  see  you  if  they  have  further 
questions;  or  would  you  like  the  program  to  be  used  as  an  adjunct  to  your  instruction, 
meaning  that  the  program  would  provide  an  opportunity  for  clients  to  practice  skills  that 
you  have  already  taught  them?  Please  check  one. 

All  Inclusive _  Adjunct  24 

12.  Would  you  like  a  workbook  to: 

A.  Explain  how  to  run  the  program  for  clients  to  refer  to  when  needed?  Yes  25 

No _ 

B.  Be  used  as  a  reference  for  clients  to  take  with  them  after  completing  the  computer 

lesson?  Yes^  No _ 

13.  In  what  capacity  would  you  use  this  program? 

_ IQ  First  introduction  to  nutrition  before  they  see  me 

21  As  an  adjunct  to  my  counseling 
_ To  replace  basic  nutrition  classes  currently  being  taught 

OTHER:  Teaching  tool  to  reinforce  concepts,  practice  sessions  that  apply  what  I  teach, 
use  for  patients  without  consults. 

14.  How  long  should  the  lesson  be?  Please  check  one. 

30  minutes  2S  45  minutes _ 60  minutes _ 

Any  Other  Comments  You  Would  Like  to 
Address: _ _ 


Thank-you  once  again  for  your  time  and  input.  Your  comments  are  very  important  to  the  completion  of 
this  project.  If  you  have  any  questions,  please  call  me  at  770-396-0006,  or  e-mail  me  at 
CaptDebi@aol.com 

Please  return  survey  in  the  self-addressed  envelope  by  June  24, 1998  to: 

Captain  Deborah  J  Carlton 
5008  Wingate  Way 
Dunwoody,  Ga  30350 
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Item  By  Objective  Embedded  Test  1 


Item  By  Objective  Embedded  Test  2 


53 


Item  By  Objective  Embedded  Test  3 


54 


%Students  Correct  100 


%Correct 


%Correct _  80  |  100  |  88  |  86  |  57  |  100  |  60  |  3 

‘Please  note  students  were  required  to  review  a  minimum  of  1  vitamin  or  mineral 

An  *  indicates  student  viewed  the  information  BUT  answer  was  wrong,  X  indicates  correct  response 


Attitude  Questionnaire 


Attitude  Questionnaire 


ABSTRACT 


DEBORAH  J.  CARLTON,  RD,  CDE 

Design,  development,  and  formative  evaluation  of  “Put  Nutrition  Into  Practice”  a 
multimedia  nutrition  education  software  program  for  adults. 

(Under  the  direction  of  JANA  R.  KICKLIGHTER,  PhD,  RD) 

The  piirpose  of  this  study  was  to  design,  develop,  and  formatively  evaluate  a  computer- 
based  multimedia  nutrition  education  program  for  adults  based  on  the  Dick  and  Carey  (1) 
model  of  instructional  design.  The  four  phases  of  the  study  design  included  analysis, 
design,  development  and  evaluation.  Seventy-two  volimteers,  18-50  years  old,  in  the  Air 
Force  participated  in  two  focus  groups,  an  e-mail  survey  and  dietitian  survey  to  establish 
the  program’s  instructional  goal  which  was  to  apply  the  principles  of  the  Food  Guide 
Pyramid  to  daily  food  choices.  Objectives,  assessment  instruments,  content,  examples, 
and  practice  questions  with  feedback  were  written  prior  to  program  development.  The 
four  modules  of  instruction  were  programmed  using  HyperStudio™  and  included 
Familiarization  with  Food  Groups,  Serving  Sizes,  Modifying  a  Menu,  and  Vitamins  and 
Minerals.  Eighteen  volunteers,  18-50  years  old,  with  a  least  a  high  school  education  and 
an  average  knowledge  of  nutrition,  volunteered  to  participate  in  two  formative  evaluation 
phases.  All  subjects  completed  a  pre-test,  two  post-tests,  three  embedded  tests  and  an 
attitude  questionnaire  which  were  used  to  ascertain  strengths  and  weaknesses  in  the 
program.  One  module  was  deleted  in  phase  one  because  the  material  lacked  relevance  to 
subjects.  Subjects  had  difficulty  identifying  serving  sizes  in  phase  two,  only  4  of  1 5  and 


6  of  15  subjects  mastered  this  objective  in  module  two  and  on  post-test  one,  respectively. 
Back  buttons  and  review  screens  were  added  to  modules  two  and  three  to  help  subjects 
master  identification  of  serving  sizes. 
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adults,  HyperStudio™,  nutrition  education  software 


